Nov 03 17:15:55.834577 ip-10-0-137-219 systemd[1]: Starting Kubernetes Kubelet...
Nov 03 17:15:56.189531 ip-10-0-137-219 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 17:15:56.189531 ip-10-0-137-219 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 03 17:15:56.189531 ip-10-0-137-219 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 17:15:56.189531 ip-10-0-137-219 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 17:15:56.193752 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193663    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 17:15:56.193752 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193748    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 17:15:56.193752 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193753    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 17:15:56.193752 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193757    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193761    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193766    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193771    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193785    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193792    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193796    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193801    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193805    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193809    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193813    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193817    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193821    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193825    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193829    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193832    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193837    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193841    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193845    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 17:15:56.193998 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193849    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193853    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193857    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193861    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193865    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193870    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193873    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193876    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193880    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193885    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193889    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193893    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193898    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193902    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193907    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193911    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193915    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193919    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193928    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193934    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 17:15:56.194793 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193939    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193944    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193949    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193953    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193957    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193961    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193966    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193970    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193974    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193979    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193983    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193987    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193991    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.193995    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194000    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194004    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194009    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194015    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194019    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194023    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 17:15:56.195660 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194028    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194032    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194036    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194040    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194045    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194050    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194055    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194060    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194064    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194068    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194073    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194078    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194082    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194087    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194091    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194096    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194100    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194104    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194108    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194112    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 17:15:56.196178 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194117    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194121    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194125    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194130    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194134    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194138    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194144    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194149    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194153    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194157    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194161    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194165    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194169    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194173    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194177    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194181    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194186    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194191    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194196    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194200    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 17:15:56.196694 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194205    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194209    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194213    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.194217    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195510    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195521    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195525    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195530    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195534    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195538    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195543    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195547    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195552    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195556    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195561    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195565    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195593    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195602    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195607    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195612    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 17:15:56.197174 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195618    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195622    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195627    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195631    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195636    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195640    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195644    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195648    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195653    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195657    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195662    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195667    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195670    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195674    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195678    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195682    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195686    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195693    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195698    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195702    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 17:15:56.197705 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195707    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195711    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195715    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195720    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195724    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195728    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195732    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195737    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195741    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195745    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195749    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195754    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195758    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195762    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195766    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195808    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195813    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195817    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195821    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 17:15:56.198190 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195829    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195834    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195838    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195841    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195844    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195847    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195850    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195852    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195856    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195859    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195862    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195864    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195867    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195870    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195873    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195875    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195878    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195881    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195883    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195886    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 17:15:56.198963 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195889    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195891    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195894    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195897    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195899    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195902    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195905    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195907    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195911    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195915    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195918    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195921    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195923    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195926    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195929    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195932    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195934    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195938    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195942    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 17:15:56.199609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195945    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195947    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195950    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195953    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195955    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195958    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195960    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195963    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195966    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195968    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195971    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.195975    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196513    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196518    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196521    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196524    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196527    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196529    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196532    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196535    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 17:15:56.200054 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196537    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196541    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196545    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196548    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196552    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196555    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196558    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196560    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196563    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196565    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196568    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196571    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196573    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196576    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196578    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196581    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196585    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196588    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196591    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 17:15:56.200556 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196593    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196596    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196598    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196601    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196604    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196606    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196609    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196612    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196615    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196617    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196620    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196622    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196625    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196627    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196633    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196636    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196639    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196641    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196644    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 17:15:56.201001 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196647    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196649    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196652    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196655    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196657    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196660    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196663    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196665    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196668    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196670    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196673    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196675    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196678    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196680    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196683    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196686    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196688    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196691    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196694    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196697    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 17:15:56.201481 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196699    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196702    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196704    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196707    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196710    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196712    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196715    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196718    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196721    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196723    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196727    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196730    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196732    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196735    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196738    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196740    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196743    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196745    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196748    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196750    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 17:15:56.201957 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196753    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196755    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196758    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196761    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196763    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196766    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196768    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196771    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196773    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196776    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196778    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196781    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196783    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196786    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196788    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196791    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196793    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196796    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196798    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.196801    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 17:15:56.202457 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196914    2576 flags.go:64] FLAG: --address="0.0.0.0"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196922    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196929    2576 flags.go:64] FLAG: --anonymous-auth="true"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196935    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196940    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196943    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196948    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196952    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196955    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196959    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196963    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196966    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196969    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196972    2576 flags.go:64] FLAG: --cgroup-root=""
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196975    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196978    2576 flags.go:64] FLAG: --client-ca-file=""
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196981    2576 flags.go:64] FLAG: --cloud-provider="external"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196984    2576 flags.go:64] FLAG: --cluster-dns="[]"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196992    2576 flags.go:64] FLAG: --cluster-domain=""
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196994    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.196998    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197001    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197005    2576 flags.go:64] FLAG: --container-log-max-files="5"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197009    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 03 17:15:56.202928 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197012    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197015    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197019    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197022    2576 flags.go:64] FLAG: --contention-profiling="false"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197025    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197028    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197031    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197035    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197039    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197042    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197045    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197048    2576 flags.go:64] FLAG: --enable-load-reader="false"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197051    2576 flags.go:64] FLAG: --enable-server="true"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197054    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197058    2576 flags.go:64] FLAG: --event-burst="100"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197062    2576 flags.go:64] FLAG: --event-qps="50"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197064    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197068    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197071    2576 flags.go:64] FLAG: --eviction-hard=""
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197075    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197078    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197081    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197084    2576 flags.go:64] FLAG: --eviction-soft=""
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197087    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197090    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 03 17:15:56.203561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197093    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197096    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197099    2576 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197102    2576 flags.go:64] FLAG: --fail-swap-on="true"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197105    2576 flags.go:64] FLAG: --feature-gates=""
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197109    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197113    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197116    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197121    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197125    2576 flags.go:64] FLAG: --healthz-port="10248"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197128    2576 flags.go:64] FLAG: --help="false"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197131    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197134    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197137    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197140    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197144    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197147    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197150    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197153    2576 flags.go:64] FLAG: --image-service-endpoint=""
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197156    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197159    2576 flags.go:64] FLAG: --kube-api-burst="100"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197162    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197165    2576 flags.go:64] FLAG: --kube-api-qps="50"
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197168    2576 flags.go:64] FLAG: --kube-reserved=""
Nov 03 17:15:56.204168 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197171    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197174    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197177    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197180    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197184    2576 flags.go:64] FLAG: --lock-file=""
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197186    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197189    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197192    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197198    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197201    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197204    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197207    2576 flags.go:64] FLAG: --logging-format="text"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197210    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197214    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197216    2576 flags.go:64] FLAG: --manifest-url=""
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197219    2576 flags.go:64] FLAG: --manifest-url-header=""
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197239    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197242    2576 flags.go:64] FLAG: --max-open-files="1000000"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197246    2576 flags.go:64] FLAG: --max-pods="110"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197251    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197254    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197258    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197262    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197265    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197268    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 03 17:15:56.204783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197271    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197278    2576 flags.go:64] FLAG: --node-status-max-images="50"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197281    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197284    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197288    2576 flags.go:64] FLAG: --pod-cidr=""
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197291    2576 flags.go:64] FLAG: --pod-manifest-path=""
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197294    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197297    2576 flags.go:64] FLAG: --pods-per-core="0"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197300    2576 flags.go:64] FLAG: --port="10250"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197303    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197306    2576 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-05a18e1f5a6b228eb"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197309    2576 flags.go:64] FLAG: --qos-reserved=""
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197312    2576 flags.go:64] FLAG: --read-only-port="10255"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197315    2576 flags.go:64] FLAG: --register-node="true"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197318    2576 flags.go:64] FLAG: --register-with-taints=""
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197322    2576 flags.go:64] FLAG: --registry-burst="10"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197325    2576 flags.go:64] FLAG: --registry-qps="5"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197328    2576 flags.go:64] FLAG: --reserved-cpus=""
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197331    2576 flags.go:64] FLAG: --reserved-memory=""
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197334    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197338    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197341    2576 flags.go:64] FLAG: --rotate-certificates="false"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197344    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197348    2576 flags.go:64] FLAG: --runonce="false"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197351    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197355    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197359    2576 flags.go:64] FLAG: --seccomp-default="false"
Nov 03 17:15:56.205398 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197362    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197365    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197369    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197372    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197375    2576 flags.go:64] FLAG: --storage-driver-password="root"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197378    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197381    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197384    2576 flags.go:64] FLAG: --storage-driver-user="root"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197387    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197391    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197395    2576 flags.go:64] FLAG: --system-cgroups=""
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197398    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197403    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197406    2576 flags.go:64] FLAG: --tls-cert-file=""
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197409    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197413    2576 flags.go:64] FLAG: --tls-min-version=""
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197416    2576 flags.go:64] FLAG: --tls-private-key-file=""
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197419    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197422    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197425    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197428    2576 flags.go:64] FLAG: --v="2"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197444    2576 flags.go:64] FLAG: --version="false"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197449    2576 flags.go:64] FLAG: --vmodule=""
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197454    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197457    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 03 17:15:56.206021 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197590    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197594    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197598    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197603    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197606    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197610    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197615    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197618    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197620    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197623    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197626    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197628    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197631    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197634    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197636    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197639    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197642    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197645    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197648    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 17:15:56.206658 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197650    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197653    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197657    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197661    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197664    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197667    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197669    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197672    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197674    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197677    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197680    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197682    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197685    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197687    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197690    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197692    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197696    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197699    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197701    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 17:15:56.207108 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197705    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197707    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197710    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197713    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197716    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197719    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197722    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197724    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197727    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197730    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197732    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197735    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197738    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197741    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197743    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197746    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197748    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197751    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197753    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 17:15:56.207616 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197756    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197758    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197761    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197763    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197766    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197768    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197771    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197773    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197776    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197778    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197782    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197784    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197787    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197792    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197794    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197797    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197799    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197802    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197804    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 17:15:56.208081 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197807    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197810    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197812    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197815    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197817    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197820    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197822    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197825    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197828    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197830    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197833    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197835    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197838    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197840    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197843    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197845    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197848    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197851    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197853    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197855    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 17:15:56.208546 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197858    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 17:15:56.209003 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197860    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 17:15:56.209003 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197863    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 17:15:56.209003 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197866    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 17:15:56.209003 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197869    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 17:15:56.209003 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197871    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 17:15:56.209003 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197875    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 17:15:56.209003 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197878    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 17:15:56.209003 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197881    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 17:15:56.209003 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197883    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 17:15:56.209003 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.197908    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 17:15:56.209003 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197945    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 17:15:56.209003 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197950    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 17:15:56.209003 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197953    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 17:15:56.209003 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197956    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 17:15:56.209003 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197958    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 17:15:56.209003 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197962    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197966    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197969    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197973    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197977    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197980    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197983    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197986    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197988    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197991    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197994    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197996    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.197999    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198001    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198004    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198006    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198009    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198012    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198014    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198018    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 17:15:56.209476 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198021    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198024    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198027    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198030    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198033    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198036    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198039    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198041    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198044    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198047    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198050    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198052    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198055    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198058    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198060    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198063    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198065    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198068    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198071    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 17:15:56.209945 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198074    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198077    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198079    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198082    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198084    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198087    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198090    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198092    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198095    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198098    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198101    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198103    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198107    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198110    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198112    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198115    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198119    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198121    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198124    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 17:15:56.210425 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198127    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198129    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198132    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198135    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198137    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198140    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198142    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198145    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198148    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198150    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198153    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198156    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198158    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198161    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198163    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198166    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198169    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198171    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198174    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198176    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 17:15:56.210877 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198178    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198181    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198184    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198186    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198189    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198193    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198196    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198199    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198201    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198206    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198209    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198211    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198215    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198219    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198233    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198237    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198239    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198242    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198245    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 17:15:56.211404 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198248    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198251    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198254    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.198257    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.205922    2576 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.205938    2576 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.205955    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.205960    2576 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206017    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206022    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206026    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206029    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206032    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206035    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206038    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206041    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206043    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206046    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206051    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206053    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 17:15:56.211859 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206056    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206059    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206062    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206065    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206067    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206070    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206073    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206075    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206078    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206080    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206083    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206086    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206088    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206090    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206093    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206096    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206099    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206102    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206105    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 17:15:56.212347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206107    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206110    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206112    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206115    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206118    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206120    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206122    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206125    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206127    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206130    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206133    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206136    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206140    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206144    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206147    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206150    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206153    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206156    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206159    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 17:15:56.212778 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206161    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206164    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206167    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206169    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206172    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206174    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206177    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206179    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206182    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206185    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206187    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206190    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206192    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206195    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206198    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206200    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206203    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206205    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206208    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206210    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 17:15:56.213273 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206213    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206215    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206218    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206220    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206237    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206241    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206243    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206246    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206250    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206253    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206255    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206258    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206260    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206263    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206266    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206268    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206271    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206274    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206276    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206279    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 17:15:56.213726 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206282    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 17:15:56.214247 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206284    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 17:15:56.214247 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206287    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 17:15:56.214247 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206289    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 17:15:56.214247 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206291    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 17:15:56.214247 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206294    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 17:15:56.214247 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206297    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 17:15:56.214247 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206299    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 17:15:56.214247 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206303    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 17:15:56.214247 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206307    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 17:15:56.214247 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206309    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 17:15:56.214247 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206313    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 17:15:56.214247 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206316    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 17:15:56.214247 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206319    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 17:15:56.214247 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206321    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 17:15:56.214247 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206324    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 17:15:56.214609 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.206359    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 17:15:56.214609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206522    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 17:15:56.214609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206528    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 17:15:56.214609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206531    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 17:15:56.214609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206534    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 17:15:56.214609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206538    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 17:15:56.214609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206540    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 17:15:56.214609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206543    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 17:15:56.214609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206546    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 17:15:56.214609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206549    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 17:15:56.214609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206552    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 17:15:56.214609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206554    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 17:15:56.214609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206557    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 17:15:56.214609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206560    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 17:15:56.214609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206563    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 17:15:56.214609 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206565    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206569    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206573    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206576    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206579    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206582    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206584    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206587    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206589    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206592    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206594    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206597    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206600    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206602    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206605    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206607    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206609    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206613    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206615    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 17:15:56.215016 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206618    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206621    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206623    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206626    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206630    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206632    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206635    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206638    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206640    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206643    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206645    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206647    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206650    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206652    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206655    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206658    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206660    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206663    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206666    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 17:15:56.215564 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206668    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206671    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206674    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206677    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206679    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206682    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206684    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206687    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206689    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206692    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206694    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206697    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206699    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206704    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206707    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206709    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206712    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206714    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206717    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206720    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 17:15:56.216116 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206722    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206725    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206727    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206730    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206733    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206735    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206738    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206740    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206743    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206746    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206748    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206752    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206755    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206758    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206761    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206764    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206766    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206769    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206772    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 17:15:56.216605 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206774    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 17:15:56.217051 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206777    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 17:15:56.217051 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206779    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 17:15:56.217051 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206782    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 17:15:56.217051 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206784    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 17:15:56.217051 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206787    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 17:15:56.217051 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206791    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 17:15:56.217051 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206794    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 17:15:56.217051 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206797    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 17:15:56.217051 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206799    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 17:15:56.217051 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206802    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 17:15:56.217051 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206805    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 17:15:56.217051 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206808    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 17:15:56.217051 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206810    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 17:15:56.217051 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206813    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 17:15:56.217051 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.206836    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 17:15:56.217051 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206868    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206873    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206876    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206879    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206882    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206885    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206888    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206890    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206893    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206896    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206899    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206901    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206904    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206906    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206909    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206911    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206914    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206917    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206920    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 17:15:56.217471 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206922    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206925    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206928    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206930    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206937    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206940    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206942    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206945    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206948    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206950    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206953    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206956    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206959    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206961    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206964    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206967    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206969    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206972    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206974    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206977    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 17:15:56.222795 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206980    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206982    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206985    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206988    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206990    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206993    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.206996    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207000    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207003    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207005    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207009    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207012    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207015    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207019    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207022    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207024    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207028    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207031    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207034    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 17:15:56.223283 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207037    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207039    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207042    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207044    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207047    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207050    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207053    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207056    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207058    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207061    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207064    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207066    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207069    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207071    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207075    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207078    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207080    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207083    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207085    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 17:15:56.223745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207088    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207092    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207094    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207097    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207100    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207102    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207105    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207108    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207111    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207113    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207119    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207122    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207126    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207128    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207131    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207134    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207136    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207139    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207142    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 17:15:56.224170 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207144    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 17:15:56.224617 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207147    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 17:15:56.224617 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207149    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 17:15:56.224617 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207152    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 17:15:56.224617 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207155    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 17:15:56.224617 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207158    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 17:15:56.224617 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207160    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 17:15:56.224617 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207163    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 17:15:56.224617 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207166    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 17:15:56.224617 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:56.207168    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 17:15:56.224617 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.207237    2576 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 03 17:15:56.224617 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.209551    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 03 17:15:56.224617 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.211517    2576 server.go:1014] "Starting client certificate rotation"
Nov 03 17:15:56.224617 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.211618    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 03 17:15:56.224617 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.211654    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 03 17:15:56.224617 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.214235    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 03 17:15:56.224617 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.219891    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 03 17:15:56.231940 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.231919    2576 log.go:25] "Validated CRI v1 runtime API"
Nov 03 17:15:56.234849 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.234835    2576 log.go:25] "Validated CRI v1 image API"
Nov 03 17:15:56.236097 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.236068    2576 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 03 17:15:56.238883 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.238860    2576 fs.go:135] Filesystem UUIDs: map[1a17df9a-0424-4e24-a761-391cdb66cacf:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e310cb75-040b-42fc-8bfe-edca5d1ef92d:/dev/nvme0n1p4]
Nov 03 17:15:56.238964 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.238883    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 03 17:15:56.244783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.244665    2576 manager.go:217] Machine: {Timestamp:2026-11-03 17:15:56.243211376 +0000 UTC m=+0.297935533 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097586 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a53e49d45af4949e1068954b9d4f5 SystemUUID:ec2a53e4-9d45-af49-49e1-068954b9d4f5 BootID:a7e901dc-a995-419f-9c02-ef9997ddf1bf Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:06:ff:e5:87:45:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:06:ff:e5:87:45:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:c9:f6:a5:24:af Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 03 17:15:56.244783 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.244776    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 03 17:15:56.244912 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.244889    2576 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 03 17:15:56.246971 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.246940    2576 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 03 17:15:56.247097 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.246972    2576 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-219.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 03 17:15:56.247146 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.247100    2576 topology_manager.go:143] "Creating topology manager with none policy"
Nov 03 17:15:56.247146 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.247107    2576 container_manager_linux.go:311] "Creating device plugin manager"
Nov 03 17:15:56.247146 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.247138    2576 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 03 17:15:56.247239 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.247156    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 03 17:15:56.248327 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.248317    2576 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 03 17:15:56.252923 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.252909    2576 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 03 17:15:56.253037 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.253028    2576 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 03 17:15:56.253832 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.253822    2576 kubelet.go:493] "Attempting to sync node with API server"
Nov 03 17:15:56.253864 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.253836    2576 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 03 17:15:56.253864 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.253846    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 03 17:15:56.253864 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.253855    2576 kubelet.go:405] "Adding apiserver pod source"
Nov 03 17:15:56.253864 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.253863    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 03 17:15:56.254264 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.254251    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 03 17:15:56.256691 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.256670    2576 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 03 17:15:56.264952 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.264939    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 03 17:15:56.265937 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.265924    2576 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 03 17:15:56.265984 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.265955    2576 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 03 17:15:56.266106 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.266097    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 03 17:15:56.266138 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.266112    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 03 17:15:56.266138 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.266118    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 03 17:15:56.266138 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.266124    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 03 17:15:56.266138 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.266130    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 03 17:15:56.266138 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.266135    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 03 17:15:56.266945 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.266936    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 03 17:15:56.266945 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.266945    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 03 17:15:56.267003 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.266953    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 03 17:15:56.267003 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.266959    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 03 17:15:56.267003 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.266968    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 03 17:15:56.267003 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.266978    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 03 17:15:56.268715 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.268704    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 03 17:15:56.268715 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.268714    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 03 17:15:56.272459 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.272445    2576 server.go:1263] "Started kubelet"
Nov 03 17:15:56.272532 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.272498    2576 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 03 17:15:56.272589 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.272526    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 03 17:15:56.272637 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.272593    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 03 17:15:56.273186 ip-10-0-137-219 systemd[1]: Started Kubernetes Kubelet.
Nov 03 17:15:56.274127 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.274107    2576 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 03 17:15:56.274351 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.274325    2576 server.go:317] "Adding debug handlers to kubelet server"
Nov 03 17:15:56.279296 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.279274    2576 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 03 17:15:56.282831 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.282813    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 03 17:15:56.283491 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.283477    2576 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 03 17:15:56.283706 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.283679    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:15:56.284297 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.284282    2576 factory.go:55] Registering systemd factory
Nov 03 17:15:56.284399 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.284384    2576 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 03 17:15:56.284457 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.284405    2576 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 03 17:15:56.284457 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.284386    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 03 17:15:56.284537 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.284496    2576 reconstruct.go:97] "Volume reconstruction finished"
Nov 03 17:15:56.284537 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.284503    2576 reconciler.go:29] "Reconciler: start to sync state"
Nov 03 17:15:56.284804 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.284789    2576 factory.go:223] Registration of the systemd container factory successfully
Nov 03 17:15:56.285007 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.284994    2576 factory.go:153] Registering CRI-O factory
Nov 03 17:15:56.285057 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.285009    2576 factory.go:223] Registration of the crio container factory successfully
Nov 03 17:15:56.285057 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.285050    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 03 17:15:56.285147 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.285065    2576 factory.go:103] Registering Raw factory
Nov 03 17:15:56.285147 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.285076    2576 manager.go:1199] Started watching for new ooms in manager
Nov 03 17:15:56.286588 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.286575    2576 manager.go:319] Starting recovery of all containers
Nov 03 17:15:56.293489 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.293440    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 03 17:15:56.297996 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.297978    2576 manager.go:324] Recovery completed
Nov 03 17:15:56.302908 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.302892    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 17:15:56.304505 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.304484    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 17:15:56.304575 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.304520    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 17:15:56.304575 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.304531    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 17:15:56.305068 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.305052    2576 cpu_manager.go:226] "Starting" policy="none"
Nov 03 17:15:56.305068 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.305065    2576 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 03 17:15:56.305164 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.305068    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 17:15:56.305164 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.305084    2576 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 03 17:15:56.305758 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.305744    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 17:15:56.305847 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.305770    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 17:15:56.305847 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.305779    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 17:15:56.307394 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.307382    2576 policy_none.go:50] "Start"
Nov 03 17:15:56.307394 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.307397    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 03 17:15:56.307483 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.307407    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 03 17:15:56.309649 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.309631    2576 policy_none.go:44] "Start"
Nov 03 17:15:56.361634 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.353581    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 03 17:15:56.361634 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.353600    2576 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 03 17:15:56.361634 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.353620    2576 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 03 17:15:56.361634 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.353656    2576 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 03 17:15:56.361634 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.354867    2576 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 03 17:15:56.361634 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.357866    2576 manager.go:341] "Starting Device Plugin manager"
Nov 03 17:15:56.361634 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.357897    2576 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 03 17:15:56.361634 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.357907    2576 server.go:87] "Starting device plugin registration server"
Nov 03 17:15:56.361634 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.358170    2576 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 03 17:15:56.361634 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.358180    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 03 17:15:56.361634 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.358301    2576 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 03 17:15:56.361634 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.358379    2576 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 03 17:15:56.361634 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.358386    2576 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 03 17:15:56.361634 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.358854    2576 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 03 17:15:56.361634 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.358894    2576 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:15:56.408416 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.408385    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-219.us-west-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 03 17:15:56.409536 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.408382    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-219.us-west-2.compute.internal.18e4986f80f1b3d9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-219.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-219.us-west-2.compute.internal,},FirstTimestamp:2026-11-03 17:15:56.272415705 +0000 UTC m=+0.327139862,LastTimestamp:2026-11-03 17:15:56.272415705 +0000 UTC m=+0.327139862,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-219.us-west-2.compute.internal,}"
Nov 03 17:15:56.453992 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.453900    2576 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal"]
Nov 03 17:15:56.453992 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.453965    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 17:15:56.454950 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.454934    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 17:15:56.455026 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.454963    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 17:15:56.455026 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.454976    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 17:15:56.457114 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.457101    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 17:15:56.457287 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.457272    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.457324 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.457313    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 17:15:56.457843 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.457828    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 17:15:56.457904 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.457850    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 17:15:56.457904 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.457864    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 17:15:56.457904 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.457872    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 17:15:56.457904 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.457902    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 17:15:56.458035 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.457912    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 17:15:56.459188 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.459174    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 17:15:56.459807 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.459790    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 17:15:56.459899 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.459818    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 17:15:56.459899 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.459831    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 17:15:56.459899 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.459849    2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.459989 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.459920    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.459989 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.459940    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 17:15:56.460605 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.460592    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 17:15:56.460675 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.460611    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 17:15:56.460675 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.460620    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 17:15:56.463636 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.463612    2576 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-219.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 03 17:15:56.464343 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.464323    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Nov 03 17:15:56.464343 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.464322    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass"
Nov 03 17:15:56.473504 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.473484    2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 03 17:15:56.473586 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.473524    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4k2tk"
Nov 03 17:15:56.484018 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.484001    2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-219.us-west-2.compute.internal\" not found" node="ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.485888 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.485873    2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-219.us-west-2.compute.internal\" not found" node="ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.486399 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.486379    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20468b9466c50fbce4ed8671ac1a9d57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"20468b9466c50fbce4ed8671ac1a9d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.486800 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.486409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20468b9466c50fbce4ed8671ac1a9d57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"20468b9466c50fbce4ed8671ac1a9d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.486836 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.486816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb1cf377fcbbbe2547aa17b485064a9c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"eb1cf377fcbbbe2547aa17b485064a9c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.510900 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.510876    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-219.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Nov 03 17:15:56.510900 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.510810    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-219.us-west-2.compute.internal.18e4986f82db5c35  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-219.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-219.us-west-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-219.us-west-2.compute.internal,},FirstTimestamp:2026-11-03 17:15:56.304505909 +0000 UTC m=+0.359230066,LastTimestamp:2026-11-03 17:15:56.304505909 +0000 UTC m=+0.359230066,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-219.us-west-2.compute.internal,}"
Nov 03 17:15:56.581723 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.581701    2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 17:15:56.582191 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.582174    2576 kubelet_node_status.go:115] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-137-219.us-west-2.compute.internal\" not found" node="ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.587763 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.587745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20468b9466c50fbce4ed8671ac1a9d57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"20468b9466c50fbce4ed8671ac1a9d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.587808 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.587773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20468b9466c50fbce4ed8671ac1a9d57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"20468b9466c50fbce4ed8671ac1a9d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.587808 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.587791    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb1cf377fcbbbe2547aa17b485064a9c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"eb1cf377fcbbbe2547aa17b485064a9c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.587870 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.587821    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20468b9466c50fbce4ed8671ac1a9d57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"20468b9466c50fbce4ed8671ac1a9d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.587870 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.587832    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20468b9466c50fbce4ed8671ac1a9d57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"20468b9466c50fbce4ed8671ac1a9d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.587870 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.587861    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb1cf377fcbbbe2547aa17b485064a9c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"eb1cf377fcbbbe2547aa17b485064a9c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.777470 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.777391    2576 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-219.us-west-2.compute.internal\" not found" node="ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.782489 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.782475    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 17:15:56.783467 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.783439    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 17:15:56.783578 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.783475    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 17:15:56.783578 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.783485    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 17:15:56.783578 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.783516    2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.788767 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.788755    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.790923 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.790908    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.844736 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:56.844710    2576 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:56.844736 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.844737    2576 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-219.us-west-2.compute.internal\": node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:15:56.963759 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:56.963730    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:15:57.064669 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:57.064613    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:15:57.166635 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:57.166432    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:15:57.211145 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:57.211116    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 03 17:15:57.211587 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:57.211305    2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 03 17:15:57.211587 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:57.211302    2576 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://ae4f21c5985754fdab24e2f2e3e09060-2a5fa75794b3f366.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-137-219.us-west-2.compute.internal.18e4986f82dbcebc\": read tcp 10.0.137.219:50476->18.116.56.47:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-137-219.us-west-2.compute.internal.18e4986f82dbcebc  default   4657 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-219.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-219.us-west-2.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-219.us-west-2.compute.internal,},FirstTimestamp:2026-11-03 17:15:56 +0000 UTC,LastTimestamp:2026-11-03 17:15:56.454980756 +0000 UTC m=+0.509704913,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-219.us-west-2.compute.internal,}"
Nov 03 17:15:57.266769 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:57.266735    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:15:57.367792 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:57.367717    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:15:57.467794 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:57.467764    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:15:57.479571 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:57.479540    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 17:10:56 +0000 UTC" deadline="2028-04-22 13:19:19.669694983 +0000 UTC"
Nov 03 17:15:57.479571 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:57.479568    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12860h3m22.190129777s"
Nov 03 17:15:57.571067 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:57.571035    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:15:57.649131 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:57.649057    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 17:15:57.650030 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:57.650014    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 17:15:57.650112 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:57.650047    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 17:15:57.650112 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:57.650063    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 17:15:57.671616 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:57.671598    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:15:57.727089 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:57.727062    2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 17:15:57.772168 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:57.772138    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:15:57.873116 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:57.873078    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:15:57.902697 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:57.902625    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1cf377fcbbbe2547aa17b485064a9c.slice/crio-61a3bedb1f58b0329d222bea87e6fb944025649d8d25e0d09207bdd14ce73cfa WatchSource:0}: Error finding container 61a3bedb1f58b0329d222bea87e6fb944025649d8d25e0d09207bdd14ce73cfa: Status 404 returned error can't find the container with id 61a3bedb1f58b0329d222bea87e6fb944025649d8d25e0d09207bdd14ce73cfa
Nov 03 17:15:57.909129 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:57.909111    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 17:15:57.977817 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:57.977783    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:15:58.079555 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:58.079523    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:15:58.150897 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:58.150871    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20468b9466c50fbce4ed8671ac1a9d57.slice/crio-2fb9254e65b9145bb5a84caa9b1bb152abbe58598b653795e58cae8fb7d2685d WatchSource:0}: Error finding container 2fb9254e65b9145bb5a84caa9b1bb152abbe58598b653795e58cae8fb7d2685d: Status 404 returned error can't find the container with id 2fb9254e65b9145bb5a84caa9b1bb152abbe58598b653795e58cae8fb7d2685d
Nov 03 17:15:58.166292 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.166273    2576 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 17:15:58.166384 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.166303    2576 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 17:15:58.183944 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.183922    2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:58.253072 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.253049    2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 17:15:58.254324 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.254306    2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:15:58.255363 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.255339    2576 apiserver.go:52] "Watching apiserver"
Nov 03 17:15:58.284293 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.284268    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 03 17:15:58.362133 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.362084    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal" event={"ID":"20468b9466c50fbce4ed8671ac1a9d57","Type":"ContainerStarted","Data":"2fb9254e65b9145bb5a84caa9b1bb152abbe58598b653795e58cae8fb7d2685d"}
Nov 03 17:15:58.363242 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.363209    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal" event={"ID":"eb1cf377fcbbbe2547aa17b485064a9c","Type":"ContainerStarted","Data":"61a3bedb1f58b0329d222bea87e6fb944025649d8d25e0d09207bdd14ce73cfa"}
Nov 03 17:15:58.366615 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.366586    2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 17:15:58.366744 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.366693    2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 17:15:58.366744 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.366701    2576 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 03 17:15:58.367119 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.367095    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal","openshift-multus/multus-6dsbk","openshift-network-diagnostics/network-check-target-s7n7v","openshift-ovn-kubernetes/ovnkube-node-tgppb","openshift-cluster-node-tuning-operator/tuned-cqgxc","openshift-multus/multus-additional-cni-plugins-sxmdm","openshift-multus/network-metrics-daemon-pvnlt","openshift-network-operator/iptables-alerter-8gpj4","openshift-image-registry/node-ca-5695n","kube-system/global-pull-secret-syncer-cfrm8","kube-system/konnectivity-agent-jjqzh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k","openshift-dns/node-resolver-jfpzv"]
Nov 03 17:15:58.370947 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.370931    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:15:58.371048 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:58.371023    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvnlt" podUID="26f7336a-a2b6-4f80-b417-a9a5d1648d69"
Nov 03 17:15:58.373121 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.373104    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.375277 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.375254    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:15:58.375477 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:58.375327    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7n7v" podUID="34d75159-9865-405a-88fe-5cf738813dde"
Nov 03 17:15:58.377767 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.377746    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.380169 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.380151    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.382656 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.382640    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.385080 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.385059    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:15:58.388671 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.388640    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:15:58.391285 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.391261    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:15:58.391422 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:58.391322    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfrm8" podUID="10d51151-30e6-4c36-a13b-5af9c5ba56e8"
Nov 03 17:15:58.393629 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.393607    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jjqzh"
Nov 03 17:15:58.395872 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.395840    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.397884 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.397865    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-cni-netd\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.397975 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.397899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.397975 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.397931    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-iptables-alerter-script\") pod \"iptables-alerter-8gpj4\" (UID: \"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c\") " pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:15:58.397975 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.397953    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-host-slash\") pod \"iptables-alerter-8gpj4\" (UID: \"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c\") " pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:15:58.398137 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398001    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-sys\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.398137 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398028    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d47d6f3-b42c-4027-863e-e148d6d22726-host\") pod \"node-ca-5695n\" (UID: \"9d47d6f3-b42c-4027-863e-e148d6d22726\") " pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:15:58.398137 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398049    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-systemd\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.398137 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398069    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal"]
Nov 03 17:15:58.398137 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-etc-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.398137 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398127    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-ovn\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.398477 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398158    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-systemd\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.398477 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398162    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:15:58.398477 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398177    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-k8s-cni-cncf-io\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.398477 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398220    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-netns\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.398477 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.398477 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398291    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87dpc\" (UniqueName: \"kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc\") pod \"network-check-target-s7n7v\" (UID: \"34d75159-9865-405a-88fe-5cf738813dde\") " pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:15:58.398477 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398317    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-hostroot\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.398477 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398339    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-systemd-units\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.398477 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398365    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-node-log\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.398477 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398383    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.398477 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398400    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:15:58.398477 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398446    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-lib-modules\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.398845 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398498    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-run-netns\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.398845 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-var-lib-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.398845 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398567    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovnkube-config\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.398845 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.398845 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-socket-dir-parent\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.398845 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398647    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-kubernetes\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.398845 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysctl-d\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.398845 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398695    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gw8x\" (UniqueName: \"kubernetes.io/projected/9d47d6f3-b42c-4027-863e-e148d6d22726-kube-api-access-2gw8x\") pod \"node-ca-5695n\" (UID: \"9d47d6f3-b42c-4027-863e-e148d6d22726\") " pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:15:58.398845 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398714    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-kubelet\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.398845 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398735    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-run\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.398845 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/580c347a-163e-4e05-a1e4-497c10edb3ed-cni-binary-copy\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.398845 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398829    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-host\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.399379 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398853    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-cni-bin\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.399379 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398880    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkwbc\" (UniqueName: \"kubernetes.io/projected/580c347a-163e-4e05-a1e4-497c10edb3ed-kube-api-access-qkwbc\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.399379 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398910    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-cni-bin\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.399379 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398954    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzdj5\" (UniqueName: \"kubernetes.io/projected/b6a6ef43-27ed-4be0-becd-e5f455be56a8-kube-api-access-xzdj5\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.399379 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.398991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysconfig\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.399379 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399016    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d47d6f3-b42c-4027-863e-e148d6d22726-serviceca\") pod \"node-ca-5695n\" (UID: \"9d47d6f3-b42c-4027-863e-e148d6d22726\") " pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:15:58.399379 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399046    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovnkube-script-lib\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.399379 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399080    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-system-cni-dir\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.399379 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399113    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-modprobe-d\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.399379 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/579ad6b2-cca6-4950-b2f2-1604e8757f1a-tmp\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.399379 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399165    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-conf-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.399379 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-etc-kubernetes\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.399379 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399229    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-daemon-config\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.399379 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399276    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6dwh\" (UniqueName: \"kubernetes.io/projected/26f7336a-a2b6-4f80-b417-a9a5d1648d69-kube-api-access-b6dwh\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:15:58.399379 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-kubelet\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.399379 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399335    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.399995 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399363    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-multus-certs\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.399995 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399381    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-log-socket\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.399995 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399396    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovn-node-metrics-cert\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.399995 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399412    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8p68\" (UniqueName: \"kubernetes.io/projected/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-kube-api-access-j8p68\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.399995 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399426    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-cnibin\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.399995 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399481    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-env-overrides\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.399995 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399518    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kjm9\" (UniqueName: \"kubernetes.io/projected/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-kube-api-access-8kjm9\") pod \"iptables-alerter-8gpj4\" (UID: \"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c\") " pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:15:58.399995 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399554    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysctl-conf\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.399995 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-var-lib-kubelet\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.399995 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399617    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7zf6\" (UniqueName: \"kubernetes.io/projected/579ad6b2-cca6-4950-b2f2-1604e8757f1a-kube-api-access-w7zf6\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.399995 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399643    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-cni-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.399995 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399668    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-slash\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.399995 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-run-ovn-kubernetes\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.399995 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399711    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cnibin\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.399995 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-tuned\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.399995 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399742    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-system-cni-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.400489 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399793    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-cni-multus\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.400489 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.399823    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.436378 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.436355    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 03 17:15:58.436577 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.436562    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 03 17:15:58.436640 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.436585    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c6dxq\""
Nov 03 17:15:58.436682 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.436649    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 03 17:15:58.436938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.436921    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 03 17:15:58.436992 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.436957    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 03 17:15:58.436992 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.436969    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 03 17:15:58.436992 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.436985    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 03 17:15:58.437145 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.437048    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-whvtr\""
Nov 03 17:15:58.437145 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.437067    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-fmcvz\""
Nov 03 17:15:58.437145 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.437067    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 03 17:15:58.437145 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.437088    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 03 17:15:58.437145 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.437099    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 03 17:15:58.437145 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.437105    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 03 17:15:58.437145 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.437103    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 03 17:15:58.439349 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.439333    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 03 17:15:58.439517 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.439503    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 03 17:15:58.439900 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.439886    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-h78gf\""
Nov 03 17:15:58.442282 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.442264    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 03 17:15:58.442418 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.442400    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-czdwp\""
Nov 03 17:15:58.442771 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.442758    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 03 17:15:58.443116 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.443103    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 03 17:15:58.446659 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.446644    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 03 17:15:58.447256 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.447230    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 03 17:15:58.447386 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.447375    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h6tl4\""
Nov 03 17:15:58.470160 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.470137    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 03 17:15:58.470373 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.470361    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 03 17:15:58.470458 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.470440    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 03 17:15:58.470458 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.470452    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 03 17:15:58.470526 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.470484    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 03 17:15:58.470526 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.470511    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 03 17:15:58.470526 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.470522    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 03 17:15:58.470646 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.470572    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 03 17:15:58.470646 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.470602    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2ptg9\""
Nov 03 17:15:58.477656 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.477643    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-9lkll\""
Nov 03 17:15:58.477708 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.477686    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hwgrr\""
Nov 03 17:15:58.483407 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.483391    2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 03 17:15:58.483473 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.483427    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5zqzf"
Nov 03 17:15:58.485038 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.485024    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 03 17:15:58.500173 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cnibin\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.500322 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-socket-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.500322 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-tuned\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.500322 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500223    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-system-cni-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.500322 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500253    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-cni-multus\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.500322 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500276    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.500322 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500301    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f11f9269-8c8d-43da-a7f6-c766c17793c4-konnectivity-ca\") pod \"konnectivity-agent-jjqzh\" (UID: \"f11f9269-8c8d-43da-a7f6-c766c17793c4\") " pod="kube-system/konnectivity-agent-jjqzh"
Nov 03 17:15:58.500322 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500278    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cnibin\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.500322 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500301    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-cni-multus\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ba695c-5928-49ec-9040-3e5171c81b4b-tmp-dir\") pod \"node-resolver-jfpzv\" (UID: \"e8ba695c-5928-49ec-9040-3e5171c81b4b\") " pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500364    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-system-cni-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500366    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-cni-netd\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500429    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-iptables-alerter-script\") pod \"iptables-alerter-8gpj4\" (UID: \"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c\") " pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500452    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-cni-netd\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500505    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-host-slash\") pod \"iptables-alerter-8gpj4\" (UID: \"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c\") " pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500551    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-host-slash\") pod \"iptables-alerter-8gpj4\" (UID: \"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c\") " pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500553    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv4bv\" (UniqueName: \"kubernetes.io/projected/8322007d-27a3-43f8-b6d9-0d183f5e433f-kube-api-access-wv4bv\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500587    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-sys\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d47d6f3-b42c-4027-863e-e148d6d22726-host\") pod \"node-ca-5695n\" (UID: \"9d47d6f3-b42c-4027-863e-e148d6d22726\") " pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500625    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-systemd\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500630    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-sys\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500615    2576 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-etc-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-ovn\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500682    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d47d6f3-b42c-4027-863e-e148d6d22726-host\") pod \"node-ca-5695n\" (UID: \"9d47d6f3-b42c-4027-863e-e148d6d22726\") " pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:15:58.500720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500709    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.501524 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500714    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-systemd\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.501524 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10d51151-30e6-4c36-a13b-5af9c5ba56e8-kubelet-config\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:15:58.501524 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500716    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-etc-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.501524 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500751    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-ovn\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.501524 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-systemd\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.501524 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500784    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-k8s-cni-cncf-io\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.501524 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500802    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-netns\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.501524 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500818    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.501524 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500832    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-k8s-cni-cncf-io\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.501524 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500842    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-netns\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.501524 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500850    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.501524 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500859    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-systemd\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.501524 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87dpc\" (UniqueName: \"kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc\") pod \"network-check-target-s7n7v\" (UID: \"34d75159-9865-405a-88fe-5cf738813dde\") " pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:15:58.501524 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500890    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-hostroot\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.501524 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500906    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-systemd-units\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.501524 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-node-log\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.501524 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500938    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.502401 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500961    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:15:58.502401 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500965    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-hostroot\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.502401 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500983    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-lib-modules\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.502401 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.500997    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-systemd-units\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.502401 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.501020    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-node-log\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.502401 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.501004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-run-netns\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.502401 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.501052    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-run-netns\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.502401 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.501065    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-var-lib-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.502401 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:58.501082    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 17:15:58.502401 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.501088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovnkube-config\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.502401 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.501110    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.502401 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.501134    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-var-lib-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.502401 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:58.501163    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs podName:26f7336a-a2b6-4f80-b417-a9a5d1648d69 nodeName:}" failed. No retries permitted until 2026-11-03 17:15:59.00112467 +0000 UTC m=+3.055848837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs") pod "network-metrics-daemon-pvnlt" (UID: "26f7336a-a2b6-4f80-b417-a9a5d1648d69") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 17:15:58.502401 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.501163    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-lib-modules\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.502401 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.501180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-socket-dir-parent\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.502401 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.501202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-kubernetes\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.502401 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.501218    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysctl-d\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.503170 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.501278    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-kubernetes\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.503170 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.501663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gw8x\" (UniqueName: \"kubernetes.io/projected/9d47d6f3-b42c-4027-863e-e148d6d22726-kube-api-access-2gw8x\") pod \"node-ca-5695n\" (UID: \"9d47d6f3-b42c-4027-863e-e148d6d22726\") " pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:15:58.503170 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.501274    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-socket-dir-parent\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.503170 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502009    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.503170 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502017    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.503170 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502028    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysctl-d\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.503170 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502067    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.503170 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-kubelet\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.503170 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502441    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-iptables-alerter-script\") pod \"iptables-alerter-8gpj4\" (UID: \"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c\") " pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:15:58.503170 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502441    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-kubelet\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.503170 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502520    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovnkube-config\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.503170 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502546    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.503170 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8ba695c-5928-49ec-9040-3e5171c81b4b-hosts-file\") pod \"node-resolver-jfpzv\" (UID: \"e8ba695c-5928-49ec-9040-3e5171c81b4b\") " pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:15:58.503170 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-run\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.503170 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502655    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/580c347a-163e-4e05-a1e4-497c10edb3ed-cni-binary-copy\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.503170 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502681    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-host\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.503170 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502713    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-cni-bin\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.503938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkwbc\" (UniqueName: \"kubernetes.io/projected/580c347a-163e-4e05-a1e4-497c10edb3ed-kube-api-access-qkwbc\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.503938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502777    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-cni-bin\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.503938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzdj5\" (UniqueName: \"kubernetes.io/projected/b6a6ef43-27ed-4be0-becd-e5f455be56a8-kube-api-access-xzdj5\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.503938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysconfig\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.503938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502866    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d47d6f3-b42c-4027-863e-e148d6d22726-serviceca\") pod \"node-ca-5695n\" (UID: \"9d47d6f3-b42c-4027-863e-e148d6d22726\") " pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:15:58.503938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502897    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovnkube-script-lib\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.503938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502926    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-run\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.503938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502931    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-system-cni-dir\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.503938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.502987    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-sys-fs\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.503938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503018    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-modprobe-d\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.503938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503058    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/579ad6b2-cca6-4950-b2f2-1604e8757f1a-tmp\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.503938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503095    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-conf-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.503938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503128    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-etc-kubernetes\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.503938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:15:58.503938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503200    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2m6j\" (UniqueName: \"kubernetes.io/projected/e8ba695c-5928-49ec-9040-3e5171c81b4b-kube-api-access-n2m6j\") pod \"node-resolver-jfpzv\" (UID: \"e8ba695c-5928-49ec-9040-3e5171c81b4b\") " pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:15:58.503938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-daemon-config\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.503938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6dwh\" (UniqueName: \"kubernetes.io/projected/26f7336a-a2b6-4f80-b417-a9a5d1648d69-kube-api-access-b6dwh\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:15:58.504739 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-kubelet\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.504739 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.504739 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503405    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-device-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.504739 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-multus-certs\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.504739 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503467    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovnkube-script-lib\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.504739 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-log-socket\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.504739 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovn-node-metrics-cert\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.504739 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503530    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-system-cni-dir\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.504739 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8p68\" (UniqueName: \"kubernetes.io/projected/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-kube-api-access-j8p68\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.504739 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503586    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-etc-selinux\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.504739 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f11f9269-8c8d-43da-a7f6-c766c17793c4-agent-certs\") pod \"konnectivity-agent-jjqzh\" (UID: \"f11f9269-8c8d-43da-a7f6-c766c17793c4\") " pod="kube-system/konnectivity-agent-jjqzh"
Nov 03 17:15:58.504739 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503652    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-cnibin\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.504739 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503695    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-env-overrides\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.504739 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503726    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kjm9\" (UniqueName: \"kubernetes.io/projected/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-kube-api-access-8kjm9\") pod \"iptables-alerter-8gpj4\" (UID: \"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c\") " pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:15:58.504739 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503800    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-cni-bin\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.504739 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503769    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-registration-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.504739 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503880    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-kubelet\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503897    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503918    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10d51151-30e6-4c36-a13b-5af9c5ba56e8-dbus\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503978    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-multus-certs\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.503997    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-host\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.504192    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-cni-bin\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.504623    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/580c347a-163e-4e05-a1e4-497c10edb3ed-cni-binary-copy\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.504623    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d47d6f3-b42c-4027-863e-e148d6d22726-serviceca\") pod \"node-ca-5695n\" (UID: \"9d47d6f3-b42c-4027-863e-e148d6d22726\") " pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.504727    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-modprobe-d\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.504845    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-tuned\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.504935    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-conf-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.504949    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-cnibin\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.504976    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-etc-kubernetes\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.505202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysctl-conf\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.505228    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-var-lib-kubelet\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.505254    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7zf6\" (UniqueName: \"kubernetes.io/projected/579ad6b2-cca6-4950-b2f2-1604e8757f1a-kube-api-access-w7zf6\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.505333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-cni-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.505362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-slash\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.505536 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.505376    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-env-overrides\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.506385 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.505434    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-run-ovn-kubernetes\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.506385 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.505499    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-run-ovn-kubernetes\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.506385 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.505510    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-cni-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.506385 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.505559    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-log-socket\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.506385 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.505665    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysctl-conf\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.506385 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.505842    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysconfig\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.506385 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.505951    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-var-lib-kubelet\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.506385 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.506007    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-slash\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.506741 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.506478    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-daemon-config\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.507858 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.507836    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovn-node-metrics-cert\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.508149 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.508134    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/579ad6b2-cca6-4950-b2f2-1604e8757f1a-tmp\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.564337 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:58.564315    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 17:15:58.564337 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:58.564337    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 17:15:58.564442 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:58.564350    2576 projected.go:196] Error preparing data for projected volume kube-api-access-87dpc for pod openshift-network-diagnostics/network-check-target-s7n7v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 17:15:58.564442 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:58.564401    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc podName:34d75159-9865-405a-88fe-5cf738813dde nodeName:}" failed. No retries permitted until 2026-11-03 17:15:59.064387134 +0000 UTC m=+3.119111280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-87dpc" (UniqueName: "kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc") pod "network-check-target-s7n7v" (UID: "34d75159-9865-405a-88fe-5cf738813dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 17:15:58.567622 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.567599    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gw8x\" (UniqueName: \"kubernetes.io/projected/9d47d6f3-b42c-4027-863e-e148d6d22726-kube-api-access-2gw8x\") pod \"node-ca-5695n\" (UID: \"9d47d6f3-b42c-4027-863e-e148d6d22726\") " pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:15:58.568625 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.568604    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkwbc\" (UniqueName: \"kubernetes.io/projected/580c347a-163e-4e05-a1e4-497c10edb3ed-kube-api-access-qkwbc\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.570593 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.570572    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzdj5\" (UniqueName: \"kubernetes.io/projected/b6a6ef43-27ed-4be0-becd-e5f455be56a8-kube-api-access-xzdj5\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.570698 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.570656    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8p68\" (UniqueName: \"kubernetes.io/projected/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-kube-api-access-j8p68\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.571401 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.571383    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kjm9\" (UniqueName: \"kubernetes.io/projected/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-kube-api-access-8kjm9\") pod \"iptables-alerter-8gpj4\" (UID: \"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c\") " pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:15:58.571946 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.571931    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7zf6\" (UniqueName: \"kubernetes.io/projected/579ad6b2-cca6-4950-b2f2-1604e8757f1a-kube-api-access-w7zf6\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.572125 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.572108    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6dwh\" (UniqueName: \"kubernetes.io/projected/26f7336a-a2b6-4f80-b417-a9a5d1648d69-kube-api-access-b6dwh\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:15:58.605691 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605653    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8ba695c-5928-49ec-9040-3e5171c81b4b-hosts-file\") pod \"node-resolver-jfpzv\" (UID: \"e8ba695c-5928-49ec-9040-3e5171c81b4b\") " pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:15:58.605691 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605697    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-sys-fs\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.605859 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605716    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:15:58.605859 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2m6j\" (UniqueName: \"kubernetes.io/projected/e8ba695c-5928-49ec-9040-3e5171c81b4b-kube-api-access-n2m6j\") pod \"node-resolver-jfpzv\" (UID: \"e8ba695c-5928-49ec-9040-3e5171c81b4b\") " pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:15:58.605859 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-device-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.605859 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605766    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-etc-selinux\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.605859 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f11f9269-8c8d-43da-a7f6-c766c17793c4-agent-certs\") pod \"konnectivity-agent-jjqzh\" (UID: \"f11f9269-8c8d-43da-a7f6-c766c17793c4\") " pod="kube-system/konnectivity-agent-jjqzh"
Nov 03 17:15:58.605859 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605785    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-sys-fs\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.605859 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605814    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-registration-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.605859 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:58.605828    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 17:15:58.605859 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10d51151-30e6-4c36-a13b-5af9c5ba56e8-dbus\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:15:58.605859 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605833    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-device-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.605859 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-socket-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.606297 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:58.605877    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret podName:10d51151-30e6-4c36-a13b-5af9c5ba56e8 nodeName:}" failed. No retries permitted until 2026-11-03 17:15:59.105860796 +0000 UTC m=+3.160584942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret") pod "global-pull-secret-syncer-cfrm8" (UID: "10d51151-30e6-4c36-a13b-5af9c5ba56e8") : object "kube-system"/"original-pull-secret" not registered
Nov 03 17:15:58.606297 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605906    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-registration-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.606297 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605909    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-etc-selinux\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.606297 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605784    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8ba695c-5928-49ec-9040-3e5171c81b4b-hosts-file\") pod \"node-resolver-jfpzv\" (UID: \"e8ba695c-5928-49ec-9040-3e5171c81b4b\") " pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:15:58.606297 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605925    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f11f9269-8c8d-43da-a7f6-c766c17793c4-konnectivity-ca\") pod \"konnectivity-agent-jjqzh\" (UID: \"f11f9269-8c8d-43da-a7f6-c766c17793c4\") " pod="kube-system/konnectivity-agent-jjqzh"
Nov 03 17:15:58.606297 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605935    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10d51151-30e6-4c36-a13b-5af9c5ba56e8-dbus\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:15:58.606297 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605957    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ba695c-5928-49ec-9040-3e5171c81b4b-tmp-dir\") pod \"node-resolver-jfpzv\" (UID: \"e8ba695c-5928-49ec-9040-3e5171c81b4b\") " pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:15:58.606297 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605973    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-socket-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.606297 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.605987    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv4bv\" (UniqueName: \"kubernetes.io/projected/8322007d-27a3-43f8-b6d9-0d183f5e433f-kube-api-access-wv4bv\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.606297 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.606016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.606297 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.606042    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10d51151-30e6-4c36-a13b-5af9c5ba56e8-kubelet-config\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:15:58.606297 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.606090    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.606297 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.606141    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10d51151-30e6-4c36-a13b-5af9c5ba56e8-kubelet-config\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:15:58.606297 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.606272    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ba695c-5928-49ec-9040-3e5171c81b4b-tmp-dir\") pod \"node-resolver-jfpzv\" (UID: \"e8ba695c-5928-49ec-9040-3e5171c81b4b\") " pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:15:58.606730 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.606477    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f11f9269-8c8d-43da-a7f6-c766c17793c4-konnectivity-ca\") pod \"konnectivity-agent-jjqzh\" (UID: \"f11f9269-8c8d-43da-a7f6-c766c17793c4\") " pod="kube-system/konnectivity-agent-jjqzh"
Nov 03 17:15:58.608581 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.608565    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f11f9269-8c8d-43da-a7f6-c766c17793c4-agent-certs\") pod \"konnectivity-agent-jjqzh\" (UID: \"f11f9269-8c8d-43da-a7f6-c766c17793c4\") " pod="kube-system/konnectivity-agent-jjqzh"
Nov 03 17:15:58.671752 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.671692    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2m6j\" (UniqueName: \"kubernetes.io/projected/e8ba695c-5928-49ec-9040-3e5171c81b4b-kube-api-access-n2m6j\") pod \"node-resolver-jfpzv\" (UID: \"e8ba695c-5928-49ec-9040-3e5171c81b4b\") " pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:15:58.671852 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.671750    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv4bv\" (UniqueName: \"kubernetes.io/projected/8322007d-27a3-43f8-b6d9-0d183f5e433f-kube-api-access-wv4bv\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.686545 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.686525    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6dsbk"
Nov 03 17:15:58.696947 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:58.696922    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod580c347a_163e_4e05_a1e4_497c10edb3ed.slice/crio-73bff03f30594ab262c2a30b3780f160c74e33aca26f76b4bf5f52cba21e573c WatchSource:0}: Error finding container 73bff03f30594ab262c2a30b3780f160c74e33aca26f76b4bf5f52cba21e573c: Status 404 returned error can't find the container with id 73bff03f30594ab262c2a30b3780f160c74e33aca26f76b4bf5f52cba21e573c
Nov 03 17:15:58.706578 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.706562    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:15:58.715524 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:58.715496    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod579ad6b2_cca6_4950_b2f2_1604e8757f1a.slice/crio-9450c49f1d64c168f4ca4a00b59adfb6b8529690998937d62356e730c67d7d51 WatchSource:0}: Error finding container 9450c49f1d64c168f4ca4a00b59adfb6b8529690998937d62356e730c67d7d51: Status 404 returned error can't find the container with id 9450c49f1d64c168f4ca4a00b59adfb6b8529690998937d62356e730c67d7d51
Nov 03 17:15:58.720997 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.720979    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:15:58.721055 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.721041    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:15:58.725749 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.725723    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:15:58.728201 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.728183    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jjqzh"
Nov 03 17:15:58.730745 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:58.730722    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70c6fee2_4568_4dfc_85ff_cfd1fc1c8262.slice/crio-153016ed6485aedbabcaf14789c3495ba2c493ba4b00ea2811a98926383388a4 WatchSource:0}: Error finding container 153016ed6485aedbabcaf14789c3495ba2c493ba4b00ea2811a98926383388a4: Status 404 returned error can't find the container with id 153016ed6485aedbabcaf14789c3495ba2c493ba4b00ea2811a98926383388a4
Nov 03 17:15:58.733683 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.733666    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:15:58.736692 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:58.736593    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a07e44b_2d6e_47bf_8e8d_ab42abd0e61c.slice/crio-d1c1af585cb274192fdc71ad26fc1a5aabd407f21222f2b6e3237dceb1bd9601 WatchSource:0}: Error finding container d1c1af585cb274192fdc71ad26fc1a5aabd407f21222f2b6e3237dceb1bd9601: Status 404 returned error can't find the container with id d1c1af585cb274192fdc71ad26fc1a5aabd407f21222f2b6e3237dceb1bd9601
Nov 03 17:15:58.739526 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:58.739505    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d47d6f3_b42c_4027_863e_e148d6d22726.slice/crio-af611a0e5a0907317b43fee654fd7f29e13a171511000a00c512c114f6b78560 WatchSource:0}: Error finding container af611a0e5a0907317b43fee654fd7f29e13a171511000a00c512c114f6b78560: Status 404 returned error can't find the container with id af611a0e5a0907317b43fee654fd7f29e13a171511000a00c512c114f6b78560
Nov 03 17:15:58.741730 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.741704    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:15:58.742587 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:58.742561    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:15:58.747111 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:58.747084    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a6ef43_27ed_4be0_becd_e5f455be56a8.slice/crio-48845cd48640879501870b3082845c2d1a1eea2d9a42ee3ec23a1f744c30baed WatchSource:0}: Error finding container 48845cd48640879501870b3082845c2d1a1eea2d9a42ee3ec23a1f744c30baed: Status 404 returned error can't find the container with id 48845cd48640879501870b3082845c2d1a1eea2d9a42ee3ec23a1f744c30baed
Nov 03 17:15:58.752499 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:58.752479    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8322007d_27a3_43f8_b6d9_0d183f5e433f.slice/crio-c1b6289082c6a305f4d53814654f8b65a2203e5f4318764392c7c695087cc2ef WatchSource:0}: Error finding container c1b6289082c6a305f4d53814654f8b65a2203e5f4318764392c7c695087cc2ef: Status 404 returned error can't find the container with id c1b6289082c6a305f4d53814654f8b65a2203e5f4318764392c7c695087cc2ef
Nov 03 17:15:58.755213 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:15:58.755191    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ba695c_5928_49ec_9040_3e5171c81b4b.slice/crio-8a1f3fb1db461a000f41a8bce00784f217d80bc29ff6cb7364b435a4cbf196cb WatchSource:0}: Error finding container 8a1f3fb1db461a000f41a8bce00784f217d80bc29ff6cb7364b435a4cbf196cb: Status 404 returned error can't find the container with id 8a1f3fb1db461a000f41a8bce00784f217d80bc29ff6cb7364b435a4cbf196cb
Nov 03 17:15:59.009508 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:59.009417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:15:59.009690 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:59.009594    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 17:15:59.009690 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:59.009682    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs podName:26f7336a-a2b6-4f80-b417-a9a5d1648d69 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:00.009664333 +0000 UTC m=+4.064388493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs") pod "network-metrics-daemon-pvnlt" (UID: "26f7336a-a2b6-4f80-b417-a9a5d1648d69") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 17:15:59.110252 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:59.110209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87dpc\" (UniqueName: \"kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc\") pod \"network-check-target-s7n7v\" (UID: \"34d75159-9865-405a-88fe-5cf738813dde\") " pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:15:59.110492 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:59.110304    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:15:59.110492 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:59.110407    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 17:15:59.110492 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:59.110410    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 17:15:59.110492 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:59.110436    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 17:15:59.110492 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:59.110449    2576 projected.go:196] Error preparing data for projected volume kube-api-access-87dpc for pod openshift-network-diagnostics/network-check-target-s7n7v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 17:15:59.110492 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:59.110462    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret podName:10d51151-30e6-4c36-a13b-5af9c5ba56e8 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:00.110449145 +0000 UTC m=+4.165173290 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret") pod "global-pull-secret-syncer-cfrm8" (UID: "10d51151-30e6-4c36-a13b-5af9c5ba56e8") : object "kube-system"/"original-pull-secret" not registered
Nov 03 17:15:59.110769 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:15:59.110498    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc podName:34d75159-9865-405a-88fe-5cf738813dde nodeName:}" failed. No retries permitted until 2026-11-03 17:16:00.1104825 +0000 UTC m=+4.165206663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-87dpc" (UniqueName: "kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc") pod "network-check-target-s7n7v" (UID: "34d75159-9865-405a-88fe-5cf738813dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 17:15:59.365827 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:59.365734    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6dsbk" event={"ID":"580c347a-163e-4e05-a1e4-497c10edb3ed","Type":"ContainerStarted","Data":"73bff03f30594ab262c2a30b3780f160c74e33aca26f76b4bf5f52cba21e573c"}
Nov 03 17:15:59.366860 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:59.366839    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jfpzv" event={"ID":"e8ba695c-5928-49ec-9040-3e5171c81b4b","Type":"ContainerStarted","Data":"8a1f3fb1db461a000f41a8bce00784f217d80bc29ff6cb7364b435a4cbf196cb"}
Nov 03 17:15:59.367945 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:59.367927    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxmdm" event={"ID":"b6a6ef43-27ed-4be0-becd-e5f455be56a8","Type":"ContainerStarted","Data":"48845cd48640879501870b3082845c2d1a1eea2d9a42ee3ec23a1f744c30baed"}
Nov 03 17:15:59.369053 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:59.369026    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jjqzh" event={"ID":"f11f9269-8c8d-43da-a7f6-c766c17793c4","Type":"ContainerStarted","Data":"d58ddf7f03d7429d555761fef4e0b116aa305dab8eb5da014086bbe4e36a3f79"}
Nov 03 17:15:59.370084 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:59.370064    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5695n" event={"ID":"9d47d6f3-b42c-4027-863e-e148d6d22726","Type":"ContainerStarted","Data":"af611a0e5a0907317b43fee654fd7f29e13a171511000a00c512c114f6b78560"}
Nov 03 17:15:59.371145 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:59.371124    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8gpj4" event={"ID":"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c","Type":"ContainerStarted","Data":"d1c1af585cb274192fdc71ad26fc1a5aabd407f21222f2b6e3237dceb1bd9601"}
Nov 03 17:15:59.372348 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:59.372324    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb" event={"ID":"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262","Type":"ContainerStarted","Data":"153016ed6485aedbabcaf14789c3495ba2c493ba4b00ea2811a98926383388a4"}
Nov 03 17:15:59.376155 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:59.376123    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k" event={"ID":"8322007d-27a3-43f8-b6d9-0d183f5e433f","Type":"ContainerStarted","Data":"c1b6289082c6a305f4d53814654f8b65a2203e5f4318764392c7c695087cc2ef"}
Nov 03 17:15:59.377255 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:59.377216    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cqgxc" event={"ID":"579ad6b2-cca6-4950-b2f2-1604e8757f1a","Type":"ContainerStarted","Data":"9450c49f1d64c168f4ca4a00b59adfb6b8529690998937d62356e730c67d7d51"}
Nov 03 17:15:59.486317 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:59.486262    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 17:10:58 +0000 UTC" deadline="2028-08-19 04:56:42.159682614 +0000 UTC"
Nov 03 17:15:59.486317 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:15:59.486309    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15707h40m42.673376291s"
Nov 03 17:16:00.018511 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:00.018211    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:00.018511 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:00.018412    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 17:16:00.018511 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:00.018482    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs podName:26f7336a-a2b6-4f80-b417-a9a5d1648d69 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:02.01846226 +0000 UTC m=+6.073186415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs") pod "network-metrics-daemon-pvnlt" (UID: "26f7336a-a2b6-4f80-b417-a9a5d1648d69") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 17:16:00.119953 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:00.119447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:00.119953 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:00.119532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87dpc\" (UniqueName: \"kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc\") pod \"network-check-target-s7n7v\" (UID: \"34d75159-9865-405a-88fe-5cf738813dde\") " pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:00.119953 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:00.119708    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 17:16:00.119953 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:00.119729    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 17:16:00.119953 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:00.119742    2576 projected.go:196] Error preparing data for projected volume kube-api-access-87dpc for pod openshift-network-diagnostics/network-check-target-s7n7v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 17:16:00.119953 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:00.119799    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc podName:34d75159-9865-405a-88fe-5cf738813dde nodeName:}" failed. No retries permitted until 2026-11-03 17:16:02.119780389 +0000 UTC m=+6.174504541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-87dpc" (UniqueName: "kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc") pod "network-check-target-s7n7v" (UID: "34d75159-9865-405a-88fe-5cf738813dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 17:16:00.119953 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:00.119891    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 17:16:00.119953 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:00.119930    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret podName:10d51151-30e6-4c36-a13b-5af9c5ba56e8 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:02.119916891 +0000 UTC m=+6.174641041 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret") pod "global-pull-secret-syncer-cfrm8" (UID: "10d51151-30e6-4c36-a13b-5af9c5ba56e8") : object "kube-system"/"original-pull-secret" not registered
Nov 03 17:16:00.355414 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:00.355348    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:00.355570 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:00.355351    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:00.355570 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:00.355516    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvnlt" podUID="26f7336a-a2b6-4f80-b417-a9a5d1648d69"
Nov 03 17:16:00.355679 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:00.355599    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7n7v" podUID="34d75159-9865-405a-88fe-5cf738813dde"
Nov 03 17:16:00.355679 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:00.355649    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:00.355784 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:00.355694    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfrm8" podUID="10d51151-30e6-4c36-a13b-5af9c5ba56e8"
Nov 03 17:16:00.487363 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:00.487307    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 17:10:58 +0000 UTC" deadline="2028-04-29 02:41:17.429065473 +0000 UTC"
Nov 03 17:16:00.487363 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:00.487352    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13017h25m16.94171828s"
Nov 03 17:16:02.034427 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:02.034385    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:02.035018 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:02.034599    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 17:16:02.035018 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:02.034661    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs podName:26f7336a-a2b6-4f80-b417-a9a5d1648d69 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:06.034642411 +0000 UTC m=+10.089366567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs") pod "network-metrics-daemon-pvnlt" (UID: "26f7336a-a2b6-4f80-b417-a9a5d1648d69") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 17:16:02.137501 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:02.137468    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87dpc\" (UniqueName: \"kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc\") pod \"network-check-target-s7n7v\" (UID: \"34d75159-9865-405a-88fe-5cf738813dde\") " pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:02.137596 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:02.137540    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:02.137986 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:02.137658    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 17:16:02.137986 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:02.137717    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret podName:10d51151-30e6-4c36-a13b-5af9c5ba56e8 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:06.137701045 +0000 UTC m=+10.192425209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret") pod "global-pull-secret-syncer-cfrm8" (UID: "10d51151-30e6-4c36-a13b-5af9c5ba56e8") : object "kube-system"/"original-pull-secret" not registered
Nov 03 17:16:02.137986 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:02.137800    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 17:16:02.137986 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:02.137829    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 17:16:02.137986 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:02.137841    2576 projected.go:196] Error preparing data for projected volume kube-api-access-87dpc for pod openshift-network-diagnostics/network-check-target-s7n7v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 17:16:02.137986 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:02.137888    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc podName:34d75159-9865-405a-88fe-5cf738813dde nodeName:}" failed. No retries permitted until 2026-11-03 17:16:06.137873224 +0000 UTC m=+10.192597387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-87dpc" (UniqueName: "kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc") pod "network-check-target-s7n7v" (UID: "34d75159-9865-405a-88fe-5cf738813dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 17:16:02.355652 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:02.355568    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:02.355800 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:02.355700    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7n7v" podUID="34d75159-9865-405a-88fe-5cf738813dde"
Nov 03 17:16:02.355800 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:02.355766    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:02.355913 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:02.355838    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfrm8" podUID="10d51151-30e6-4c36-a13b-5af9c5ba56e8"
Nov 03 17:16:02.355913 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:02.355884    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:02.356023 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:02.355966    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvnlt" podUID="26f7336a-a2b6-4f80-b417-a9a5d1648d69"
Nov 03 17:16:03.393518 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:03.393434    2576 generic.go:356] "Generic (PLEG): container finished" podID="b6a6ef43-27ed-4be0-becd-e5f455be56a8" containerID="ae0d5dc610763eae380e6bb0b8861a6097f36892d99353badd200c3540f4c2f0" exitCode=0
Nov 03 17:16:03.393518 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:03.393493    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxmdm" event={"ID":"b6a6ef43-27ed-4be0-becd-e5f455be56a8","Type":"ContainerDied","Data":"ae0d5dc610763eae380e6bb0b8861a6097f36892d99353badd200c3540f4c2f0"}
Nov 03 17:16:04.353868 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:04.353829    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:04.354025 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:04.353956    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfrm8" podUID="10d51151-30e6-4c36-a13b-5af9c5ba56e8"
Nov 03 17:16:04.354100 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:04.354036    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:04.354152 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:04.354113    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvnlt" podUID="26f7336a-a2b6-4f80-b417-a9a5d1648d69"
Nov 03 17:16:04.354212 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:04.354160    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:04.354282 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:04.354241    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7n7v" podUID="34d75159-9865-405a-88fe-5cf738813dde"
Nov 03 17:16:04.402169 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:04.402097    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal" event={"ID":"eb1cf377fcbbbe2547aa17b485064a9c","Type":"ContainerStarted","Data":"8597bfb71cff8c7e38626d71eb18aaf5e4e2ac261c6d02214da040f6f2a9e215"}
Nov 03 17:16:05.410421 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:05.410342    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k" event={"ID":"8322007d-27a3-43f8-b6d9-0d183f5e433f","Type":"ContainerStarted","Data":"f27a6a7cf843a2d46e4173916407d1a66ae630c0fbe9390e43e254fd71c0c49c"}
Nov 03 17:16:05.414301 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:05.414266    2576 generic.go:356] "Generic (PLEG): container finished" podID="20468b9466c50fbce4ed8671ac1a9d57" containerID="4754ea88c40141af85d18344b8c6e5f06d5b4d5ed063250f7e813957654c4564" exitCode=0
Nov 03 17:16:05.414412 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:05.414369    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal" event={"ID":"20468b9466c50fbce4ed8671ac1a9d57","Type":"ContainerDied","Data":"4754ea88c40141af85d18344b8c6e5f06d5b4d5ed063250f7e813957654c4564"}
Nov 03 17:16:05.426688 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:05.426659    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jjqzh" event={"ID":"f11f9269-8c8d-43da-a7f6-c766c17793c4","Type":"ContainerStarted","Data":"10d2a1655398557fc2c6a4aa65d56a737682164eb5bbb9617a6caa148d5a59d3"}
Nov 03 17:16:05.536664 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:05.536164    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal" podStartSLOduration=7.5361471 podStartE2EDuration="7.5361471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:15:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:04.518496948 +0000 UTC m=+8.573221119" watchObservedRunningTime="2026-11-03 17:16:05.5361471 +0000 UTC m=+9.590871267"
Nov 03 17:16:05.650982 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:05.650937    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jjqzh" podStartSLOduration=2.5769925479999998 podStartE2EDuration="8.650923181s" totalImagesPullingTime="6.073930633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:05.650885423 +0000 UTC m=+9.705609591" watchObservedRunningTime="2026-11-03 17:16:05.650923181 +0000 UTC m=+9.705647343"
Nov 03 17:16:06.072588 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:06.072509    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:06.072750 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:06.072700    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 17:16:06.072813 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:06.072758    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs podName:26f7336a-a2b6-4f80-b417-a9a5d1648d69 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:14.072740897 +0000 UTC m=+18.127465045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs") pod "network-metrics-daemon-pvnlt" (UID: "26f7336a-a2b6-4f80-b417-a9a5d1648d69") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 17:16:06.173433 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:06.173391    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:06.173625 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:06.173475    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87dpc\" (UniqueName: \"kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc\") pod \"network-check-target-s7n7v\" (UID: \"34d75159-9865-405a-88fe-5cf738813dde\") " pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:06.173690 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:06.173630    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 17:16:06.173690 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:06.173647    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 17:16:06.173690 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:06.173660    2576 projected.go:196] Error preparing data for projected volume kube-api-access-87dpc for pod openshift-network-diagnostics/network-check-target-s7n7v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 17:16:06.173851 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:06.173712    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc podName:34d75159-9865-405a-88fe-5cf738813dde nodeName:}" failed. No retries permitted until 2026-11-03 17:16:14.173695181 +0000 UTC m=+18.228419326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-87dpc" (UniqueName: "kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc") pod "network-check-target-s7n7v" (UID: "34d75159-9865-405a-88fe-5cf738813dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 17:16:06.173851 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:06.173786    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 17:16:06.173851 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:06.173822    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret podName:10d51151-30e6-4c36-a13b-5af9c5ba56e8 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:14.17381216 +0000 UTC m=+18.228536307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret") pod "global-pull-secret-syncer-cfrm8" (UID: "10d51151-30e6-4c36-a13b-5af9c5ba56e8") : object "kube-system"/"original-pull-secret" not registered
Nov 03 17:16:06.354868 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:06.354780    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:06.355027 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:06.354919    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfrm8" podUID="10d51151-30e6-4c36-a13b-5af9c5ba56e8"
Nov 03 17:16:06.355027 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:06.355004    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:06.355143 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:06.355089    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvnlt" podUID="26f7336a-a2b6-4f80-b417-a9a5d1648d69"
Nov 03 17:16:06.355195 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:06.355143    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:06.355260 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:06.355206    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7n7v" podUID="34d75159-9865-405a-88fe-5cf738813dde"
Nov 03 17:16:06.430972 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:06.430933    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal" event={"ID":"20468b9466c50fbce4ed8671ac1a9d57","Type":"ContainerStarted","Data":"991b11005161eaaac15ea9344e27eb8c4c6a2367f149699d1e307abedb32e4d0"}
Nov 03 17:16:06.433642 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:06.433582    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5695n" event={"ID":"9d47d6f3-b42c-4027-863e-e148d6d22726","Type":"ContainerStarted","Data":"528f1f853527bb94eb619933b79697361d089ac18d76608a1e1284088daf6a4b"}
Nov 03 17:16:06.663936 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:06.663792    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal" podStartSLOduration=8.66377208 podStartE2EDuration="8.66377208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:15:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:06.548860356 +0000 UTC m=+10.603584523" watchObservedRunningTime="2026-11-03 17:16:06.66377208 +0000 UTC m=+10.718496249"
Nov 03 17:16:06.664753 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:06.664703    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5695n" podStartSLOduration=3.089928946 podStartE2EDuration="9.664686459s" totalImagesPullingTime="6.574757513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:06.663485948 +0000 UTC m=+10.718210115" watchObservedRunningTime="2026-11-03 17:16:06.664686459 +0000 UTC m=+10.719410628"
Nov 03 17:16:07.440941 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:07.440595    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6dsbk" event={"ID":"580c347a-163e-4e05-a1e4-497c10edb3ed","Type":"ContainerStarted","Data":"d609ae51027afa7972cf8ef877e093ac95dc70d72629067fec560ee458e21a64"}
Nov 03 17:16:07.443450 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:07.443426    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jfpzv" event={"ID":"e8ba695c-5928-49ec-9040-3e5171c81b4b","Type":"ContainerStarted","Data":"3b2234b6779731852a1715d63d9229e4a06bde4053c5d8437c54aeef99000b05"}
Nov 03 17:16:07.506468 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:07.506442    2576 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 03 17:16:07.559537 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:07.559489    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-6dsbk" podStartSLOduration=2.013401372 podStartE2EDuration="10.559475231s" totalImagesPullingTime="8.546073859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:07.558647673 +0000 UTC m=+11.613371839" watchObservedRunningTime="2026-11-03 17:16:07.559475231 +0000 UTC m=+11.614199394"
Nov 03 17:16:07.677159 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:07.677094    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-jfpzv" podStartSLOduration=2.605462624 podStartE2EDuration="10.677073623s" totalImagesPullingTime="8.071610999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:07.676395227 +0000 UTC m=+11.731119393" watchObservedRunningTime="2026-11-03 17:16:07.677073623 +0000 UTC m=+11.731797790"
Nov 03 17:16:08.357616 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:08.357550    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:08.357758 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:08.357668    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfrm8" podUID="10d51151-30e6-4c36-a13b-5af9c5ba56e8"
Nov 03 17:16:08.357758 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:08.357754    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:08.358003 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:08.357930    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvnlt" podUID="26f7336a-a2b6-4f80-b417-a9a5d1648d69"
Nov 03 17:16:08.358003 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:08.357993    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:08.358144 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:08.358097    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7n7v" podUID="34d75159-9865-405a-88fe-5cf738813dde"
Nov 03 17:16:08.365284 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:08.365156    2576 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T17:16:07.506456174Z","UUID":"2d713277-afaf-47d2-9a01-93f4b426310d","Handler":null,"Name":"","Endpoint":""}
Nov 03 17:16:08.367005 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:08.366986    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 03 17:16:08.367120 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:08.367017    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 03 17:16:08.448154 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:08.448120    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k" event={"ID":"8322007d-27a3-43f8-b6d9-0d183f5e433f","Type":"ContainerStarted","Data":"640e98bb7e48d12d20416bbc796cdfe99c7885de884f4488b4ae7419b27420ad"}
Nov 03 17:16:08.641736 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:08.641665    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jjqzh"
Nov 03 17:16:08.783152 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:08.783070    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jjqzh"
Nov 03 17:16:08.783837 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:08.783814    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jjqzh"
Nov 03 17:16:09.451637 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:09.451608    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8gpj4" event={"ID":"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c","Type":"ContainerStarted","Data":"b5f8a21d6918e7309e1810b2d75f6d7b4d651df0c214a25df2d7d927ad0685a6"}
Nov 03 17:16:09.452442 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:09.452421    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jjqzh"
Nov 03 17:16:09.569498 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:09.569445    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8gpj4" podStartSLOduration=3.9196911070000002 podStartE2EDuration="12.569428546s" totalImagesPullingTime="8.649737439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:09.56898324 +0000 UTC m=+13.623707409" watchObservedRunningTime="2026-11-03 17:16:09.569428546 +0000 UTC m=+13.624152713"
Nov 03 17:16:10.357615 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:10.357387    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:10.357757 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:10.357456    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:10.357757 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:10.357642    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7n7v" podUID="34d75159-9865-405a-88fe-5cf738813dde"
Nov 03 17:16:10.357757 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:10.357463    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:10.357757 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:10.357736    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvnlt" podUID="26f7336a-a2b6-4f80-b417-a9a5d1648d69"
Nov 03 17:16:10.357916 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:10.357787    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfrm8" podUID="10d51151-30e6-4c36-a13b-5af9c5ba56e8"
Nov 03 17:16:10.454845 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:10.454809    2576 generic.go:356] "Generic (PLEG): container finished" podID="b6a6ef43-27ed-4be0-becd-e5f455be56a8" containerID="d82159e3176b876b991454af22aa3afa372415397f4d4c1512c895353065cb71" exitCode=0
Nov 03 17:16:10.455394 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:10.454885    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxmdm" event={"ID":"b6a6ef43-27ed-4be0-becd-e5f455be56a8","Type":"ContainerDied","Data":"d82159e3176b876b991454af22aa3afa372415397f4d4c1512c895353065cb71"}
Nov 03 17:16:10.456984 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:10.456963    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k" event={"ID":"8322007d-27a3-43f8-b6d9-0d183f5e433f","Type":"ContainerStarted","Data":"f704a770ae8e29153eb939e6606bad6d86af9781d511e3333de446037db98ef0"}
Nov 03 17:16:10.458362 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:10.458339    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cqgxc" event={"ID":"579ad6b2-cca6-4950-b2f2-1604e8757f1a","Type":"ContainerStarted","Data":"0730460c0879ef503ec2baa59b2e5f743247ea6004e29cbc2ada43300dbe6753"}
Nov 03 17:16:10.699321 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:10.699204    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k" podStartSLOduration=3.132813131 podStartE2EDuration="13.699189608s" totalImagesPullingTime="10.566376477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:15:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:10.69884339 +0000 UTC m=+14.753567557" watchObservedRunningTime="2026-11-03 17:16:10.699189608 +0000 UTC m=+14.753913810"
Nov 03 17:16:10.828545 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:10.828492    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cqgxc" podStartSLOduration=2.887071288 podStartE2EDuration="13.82847374s" totalImagesPullingTime="10.941402452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:10.828342285 +0000 UTC m=+14.883066451" watchObservedRunningTime="2026-11-03 17:16:10.82847374 +0000 UTC m=+14.883197909"
Nov 03 17:16:12.356258 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:12.354470    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:12.356258 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:12.354508    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:12.356258 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:12.354613    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7n7v" podUID="34d75159-9865-405a-88fe-5cf738813dde"
Nov 03 17:16:12.356258 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:12.354657    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:12.356258 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:12.354753    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfrm8" podUID="10d51151-30e6-4c36-a13b-5af9c5ba56e8"
Nov 03 17:16:12.356258 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:12.354834    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvnlt" podUID="26f7336a-a2b6-4f80-b417-a9a5d1648d69"
Nov 03 17:16:12.466038 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:12.465759    2576 generic.go:356] "Generic (PLEG): container finished" podID="b6a6ef43-27ed-4be0-becd-e5f455be56a8" containerID="53287564bda149b40cfe5c320cf0c7900e6b497d09840658c7893ba26972282a" exitCode=0
Nov 03 17:16:12.466038 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:12.465828    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxmdm" event={"ID":"b6a6ef43-27ed-4be0-becd-e5f455be56a8","Type":"ContainerDied","Data":"53287564bda149b40cfe5c320cf0c7900e6b497d09840658c7893ba26972282a"}
Nov 03 17:16:14.136007 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:14.135933    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:14.136430 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:14.136048    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 17:16:14.136430 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:14.136109    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs podName:26f7336a-a2b6-4f80-b417-a9a5d1648d69 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:30.136092398 +0000 UTC m=+34.190816543 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs") pod "network-metrics-daemon-pvnlt" (UID: "26f7336a-a2b6-4f80-b417-a9a5d1648d69") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 17:16:14.237196 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:14.237162    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87dpc\" (UniqueName: \"kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc\") pod \"network-check-target-s7n7v\" (UID: \"34d75159-9865-405a-88fe-5cf738813dde\") " pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:14.237386 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:14.237213    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:14.237386 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:14.237331    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 17:16:14.237386 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:14.237345    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 17:16:14.237386 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:14.237366    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 17:16:14.237386 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:14.237376    2576 projected.go:196] Error preparing data for projected volume kube-api-access-87dpc for pod openshift-network-diagnostics/network-check-target-s7n7v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 17:16:14.237386 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:14.237380    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret podName:10d51151-30e6-4c36-a13b-5af9c5ba56e8 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:30.237367632 +0000 UTC m=+34.292091776 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret") pod "global-pull-secret-syncer-cfrm8" (UID: "10d51151-30e6-4c36-a13b-5af9c5ba56e8") : object "kube-system"/"original-pull-secret" not registered
Nov 03 17:16:14.237681 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:14.237417    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc podName:34d75159-9865-405a-88fe-5cf738813dde nodeName:}" failed. No retries permitted until 2026-11-03 17:16:30.237402919 +0000 UTC m=+34.292127076 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-87dpc" (UniqueName: "kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc") pod "network-check-target-s7n7v" (UID: "34d75159-9865-405a-88fe-5cf738813dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 17:16:14.353901 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:14.353867    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:14.354056 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:14.353908    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:14.354056 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:14.353869    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:14.354056 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:14.354002    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7n7v" podUID="34d75159-9865-405a-88fe-5cf738813dde"
Nov 03 17:16:14.354254 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:14.354067    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvnlt" podUID="26f7336a-a2b6-4f80-b417-a9a5d1648d69"
Nov 03 17:16:14.354254 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:14.354134    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfrm8" podUID="10d51151-30e6-4c36-a13b-5af9c5ba56e8"
Nov 03 17:16:14.473540 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:14.473471    2576 generic.go:356] "Generic (PLEG): container finished" podID="b6a6ef43-27ed-4be0-becd-e5f455be56a8" containerID="4c6bf7e3405ff274321334c30aed98204493153358fbcf83ad2fc75bbaa051e8" exitCode=0
Nov 03 17:16:14.473540 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:14.473524    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxmdm" event={"ID":"b6a6ef43-27ed-4be0-becd-e5f455be56a8","Type":"ContainerDied","Data":"4c6bf7e3405ff274321334c30aed98204493153358fbcf83ad2fc75bbaa051e8"}
Nov 03 17:16:15.479612 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:15.479582    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb" event={"ID":"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262","Type":"ContainerStarted","Data":"ab3cb0f8841f6b0f5fc19fc20cafe8556362fe88da0cd567c89dcd6d14a83306"}
Nov 03 17:16:15.479970 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:15.479694    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb" event={"ID":"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262","Type":"ContainerStarted","Data":"75bf56e0f609b5beea4de8b7e74d12909cf3b72bc1cedb3fbf8bbbc577ea0d3e"}
Nov 03 17:16:15.479970 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:15.479728    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb" event={"ID":"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262","Type":"ContainerStarted","Data":"4a6fe643b904a0a24f6873798511cee40aea60bb34474f390206ec58b5f449c2"}
Nov 03 17:16:15.479970 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:15.479761    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb" event={"ID":"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262","Type":"ContainerStarted","Data":"499216d0e39e0d23505efc792ca48971bd74e902ae9a41ca0b18bb3fe2ebd9f4"}
Nov 03 17:16:15.479970 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:15.479797    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb" event={"ID":"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262","Type":"ContainerStarted","Data":"4a77febfd6cee24d2bd9cb4b26fa33ac636224a2eb8c77987caba8e910ff93a6"}
Nov 03 17:16:16.355404 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:16.355133    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:16.355570 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:16.355204    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:16.355570 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:16.355510    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvnlt" podUID="26f7336a-a2b6-4f80-b417-a9a5d1648d69"
Nov 03 17:16:16.355570 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:16.355248    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:16.355739 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:16.355574    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7n7v" podUID="34d75159-9865-405a-88fe-5cf738813dde"
Nov 03 17:16:16.355739 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:16.355629    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfrm8" podUID="10d51151-30e6-4c36-a13b-5af9c5ba56e8"
Nov 03 17:16:16.484287 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:16.484257    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxmdm" event={"ID":"b6a6ef43-27ed-4be0-becd-e5f455be56a8","Type":"ContainerStarted","Data":"2270a1d452911443f094932d7be10778ec5ad645e942f6287535d7d1b327bfd5"}
Nov 03 17:16:16.487211 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:16.487174    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb" event={"ID":"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262","Type":"ContainerStarted","Data":"4fd2b48a46a986db6870f3866efdd5456dc3eb579c22aad7ffa86aac29e47e88"}
Nov 03 17:16:17.492130 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:17.492097    2576 generic.go:356] "Generic (PLEG): container finished" podID="b6a6ef43-27ed-4be0-becd-e5f455be56a8" containerID="2270a1d452911443f094932d7be10778ec5ad645e942f6287535d7d1b327bfd5" exitCode=0
Nov 03 17:16:17.492508 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:17.492138    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxmdm" event={"ID":"b6a6ef43-27ed-4be0-becd-e5f455be56a8","Type":"ContainerDied","Data":"2270a1d452911443f094932d7be10778ec5ad645e942f6287535d7d1b327bfd5"}
Nov 03 17:16:18.354441 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:18.354407    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:18.354441 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:18.354439    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:18.354686 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:18.354444    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:18.354686 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:18.354512    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7n7v" podUID="34d75159-9865-405a-88fe-5cf738813dde"
Nov 03 17:16:18.354686 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:18.354595    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvnlt" podUID="26f7336a-a2b6-4f80-b417-a9a5d1648d69"
Nov 03 17:16:18.354686 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:18.354661    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfrm8" podUID="10d51151-30e6-4c36-a13b-5af9c5ba56e8"
Nov 03 17:16:18.496974 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:18.496943    2576 generic.go:356] "Generic (PLEG): container finished" podID="b6a6ef43-27ed-4be0-becd-e5f455be56a8" containerID="d3a66e5a570a70e310f5c10d8adceeac5817c27027bf44f432431d820444f891" exitCode=0
Nov 03 17:16:18.497511 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:18.497031    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxmdm" event={"ID":"b6a6ef43-27ed-4be0-becd-e5f455be56a8","Type":"ContainerDied","Data":"d3a66e5a570a70e310f5c10d8adceeac5817c27027bf44f432431d820444f891"}
Nov 03 17:16:18.500267 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:18.500244    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb" event={"ID":"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262","Type":"ContainerStarted","Data":"c3339aafe737e050f66b0f439e44814fb601ed6c6804918554ad75f86598df38"}
Nov 03 17:16:19.505835 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:19.505799    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sxmdm" event={"ID":"b6a6ef43-27ed-4be0-becd-e5f455be56a8","Type":"ContainerStarted","Data":"0851a476262eb689dee8ad4529f6f94fcd19dbe979abe159e3eb20cc60bc488f"}
Nov 03 17:16:19.728383 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:19.728340    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sxmdm" podStartSLOduration=8.078391669 podStartE2EDuration="22.728327572s" totalImagesPullingTime="14.649935903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:15:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:19.677685138 +0000 UTC m=+23.732409304" watchObservedRunningTime="2026-11-03 17:16:19.728327572 +0000 UTC m=+23.783051737"
Nov 03 17:16:20.353883 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:20.353844    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:20.353883 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:20.353877    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:20.354203 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:20.353944    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfrm8" podUID="10d51151-30e6-4c36-a13b-5af9c5ba56e8"
Nov 03 17:16:20.354203 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:20.353978    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:20.354203 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:20.354059    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvnlt" podUID="26f7336a-a2b6-4f80-b417-a9a5d1648d69"
Nov 03 17:16:20.354203 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:20.354132    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7n7v" podUID="34d75159-9865-405a-88fe-5cf738813dde"
Nov 03 17:16:20.511501 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:20.511466    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb" event={"ID":"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262","Type":"ContainerStarted","Data":"a0bc4a235108f81ec788640fae9ea4febf753f344d9f9ec8963a75255930a009"}
Nov 03 17:16:21.514144 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:21.514111    2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 03 17:16:21.514621 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:21.514581    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:21.514727 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:21.514703    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:21.530857 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:21.530677    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:21.530966 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:21.530950    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:21.811447 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:21.811359    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb" podStartSLOduration=8.357391118 podStartE2EDuration="24.811346293s" totalImagesPullingTime="16.453955175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 17:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:20.748484158 +0000 UTC m=+24.803208324" watchObservedRunningTime="2026-11-03 17:16:21.811346293 +0000 UTC m=+25.866070458"
Nov 03 17:16:22.338368 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:22.338333    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cfrm8"]
Nov 03 17:16:22.338526 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:22.338453    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:22.338564 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:22.338545    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfrm8" podUID="10d51151-30e6-4c36-a13b-5af9c5ba56e8"
Nov 03 17:16:22.341251 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:22.341215    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s7n7v"]
Nov 03 17:16:22.341331 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:22.341320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:22.341410 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:22.341392    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7n7v" podUID="34d75159-9865-405a-88fe-5cf738813dde"
Nov 03 17:16:22.344268 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:22.344248    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pvnlt"]
Nov 03 17:16:22.344346 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:22.344336    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:22.344421 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:22.344408    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvnlt" podUID="26f7336a-a2b6-4f80-b417-a9a5d1648d69"
Nov 03 17:16:22.516278 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:22.516251    2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 03 17:16:23.185419 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:23.185384    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:24.354562 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:24.354495    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:24.354994 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:24.354565    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:24.354994 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:24.354575    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:24.354994 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:24.354666    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfrm8" podUID="10d51151-30e6-4c36-a13b-5af9c5ba56e8"
Nov 03 17:16:24.354994 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:24.354751    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7n7v" podUID="34d75159-9865-405a-88fe-5cf738813dde"
Nov 03 17:16:24.354994 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:24.354839    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvnlt" podUID="26f7336a-a2b6-4f80-b417-a9a5d1648d69"
Nov 03 17:16:24.536160 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:24.536121    2576 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb" podUID="70c6fee2-4568-4dfc-85ff-cfd1fc1c8262" containerName="ovnkube-controller" probeResult="failure" output=""
Nov 03 17:16:26.355146 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:26.355109    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:26.355545 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:26.355164    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:26.355545 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:26.355246    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfrm8" podUID="10d51151-30e6-4c36-a13b-5af9c5ba56e8"
Nov 03 17:16:26.355545 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:26.355259    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:26.355545 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:26.355331    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7n7v" podUID="34d75159-9865-405a-88fe-5cf738813dde"
Nov 03 17:16:26.355545 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:26.355413    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvnlt" podUID="26f7336a-a2b6-4f80-b417-a9a5d1648d69"
Nov 03 17:16:28.234172 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.234093    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeReady"
Nov 03 17:16:28.234639 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.234276    2576 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 03 17:16:28.353632 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.353600    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-vgvw9"]
Nov 03 17:16:28.376806 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.376774    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-vgvw9"
Nov 03 17:16:28.379942 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.379919    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-8dw9x"]
Nov 03 17:16:28.398069 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.398046    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-kpfdx"]
Nov 03 17:16:28.398173 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.398145    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-8dw9x"
Nov 03 17:16:28.421427 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.416698    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"]
Nov 03 17:16:28.421427 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.420951    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-kpfdx"
Nov 03 17:16:28.421427 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.420946    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:28.421427 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.421305    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:28.422597 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.422277    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:28.432297 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.432174    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"]
Nov 03 17:16:28.432546 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.432337    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:28.450753 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.450192    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"]
Nov 03 17:16:28.451626 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.451605    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"
Nov 03 17:16:28.454057 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.454020    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Nov 03 17:16:28.474436 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.474412    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-vsdc5"]
Nov 03 17:16:28.474591 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.474527    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"
Nov 03 17:16:28.474755 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.474687    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-mr6xr\""
Nov 03 17:16:28.493344 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.493290    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c98dd6d65-rjtsq"]
Nov 03 17:16:28.493455 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.493419    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.513392 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.513372    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-678bd9c4d9-wrhq6"]
Nov 03 17:16:28.513509 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.513495    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.522786 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.522760    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqzh_f11f9269-8c8d-43da-a7f6-c766c17793c4/konnectivity-agent/0.log" limit=1024
Nov 03 17:16:28.533825 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.533800    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"]
Nov 03 17:16:28.533920 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.533902    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:28.536101 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.536080    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Nov 03 17:16:28.536101 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.536097    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Nov 03 17:16:28.536101 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.536123    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Nov 03 17:16:28.536547 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.536164    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Nov 03 17:16:28.536547 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.536215    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Nov 03 17:16:28.536547 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.536218    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Nov 03 17:16:28.536547 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.536263    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Nov 03 17:16:28.536547 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.536266    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 03 17:16:28.536547 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.536295    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Nov 03 17:16:28.536547 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.536310    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Nov 03 17:16:28.536547 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.536331    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 03 17:16:28.537093 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.537074    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Nov 03 17:16:28.537326 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.537310    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Nov 03 17:16:28.537388 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.537330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ba6ecd5-1d02-4433-b245-1c957827467e-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-btzt2\" (UID: \"7ba6ecd5-1d02-4433-b245-1c957827467e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"
Nov 03 17:16:28.537388 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.537361    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w6wx\" (UniqueName: \"kubernetes.io/projected/749ecc85-b28a-4ecd-aaf0-27de9c332713-kube-api-access-5w6wx\") pod \"kas-connection-checker-685895c7c9-kpfdx\" (UID: \"749ecc85-b28a-4ecd-aaf0-27de9c332713\") " pod="kube-system/kas-connection-checker-685895c7c9-kpfdx"
Nov 03 17:16:28.537482 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.537387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-trusted-ca\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:28.537482 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.537410    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqqmv\" (UniqueName: \"kubernetes.io/projected/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-kube-api-access-pqqmv\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:28.537482 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.537425    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sb99\" (UniqueName: \"kubernetes.io/projected/7ba6ecd5-1d02-4433-b245-1c957827467e-kube-api-access-2sb99\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-btzt2\" (UID: \"7ba6ecd5-1d02-4433-b245-1c957827467e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"
Nov 03 17:16:28.537578 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.537556    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ba6ecd5-1d02-4433-b245-1c957827467e-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-btzt2\" (UID: \"7ba6ecd5-1d02-4433-b245-1c957827467e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"
Nov 03 17:16:28.537648 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.537630    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-serving-cert\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:28.537746 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.537728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhp4d\" (UniqueName: \"kubernetes.io/projected/cf675d26-93c5-4a45-90db-7f95e260ac30-kube-api-access-mhp4d\") pod \"kas-connection-checker-685895c7c9-8dw9x\" (UID: \"cf675d26-93c5-4a45-90db-7f95e260ac30\") " pod="kube-system/kas-connection-checker-685895c7c9-8dw9x"
Nov 03 17:16:28.537792 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.537760    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp26q\" (UniqueName: \"kubernetes.io/projected/951f5784-32a9-40a3-b503-33249c04d5fc-kube-api-access-jp26q\") pod \"kas-connection-checker-685895c7c9-vgvw9\" (UID: \"951f5784-32a9-40a3-b503-33249c04d5fc\") " pod="kube-system/kas-connection-checker-685895c7c9-vgvw9"
Nov 03 17:16:28.537792 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.537778    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-config\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:28.546378 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.546363    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 03 17:16:28.546451 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.546384    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 03 17:16:28.547554 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.547539    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"]
Nov 03 17:16:28.547653 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.547639    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:28.569716 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.569692    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-thckz"]
Nov 03 17:16:28.569836 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.569819    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:28.587326 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.587260    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 03 17:16:28.587539 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.587339    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 03 17:16:28.587911 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.587892    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Nov 03 17:16:28.588014 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.587936    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Nov 03 17:16:28.588105 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.588081    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 03 17:16:28.588105 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.588096    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Nov 03 17:16:28.588105 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.587972    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Nov 03 17:16:28.588324 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.588109    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 03 17:16:28.588324 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.588124    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 03 17:16:28.588324 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.588033    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Nov 03 17:16:28.588324 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.588043    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Nov 03 17:16:28.588324 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.588056    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Nov 03 17:16:28.588324 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.588055    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x9v6p\""
Nov 03 17:16:28.588324 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.587955    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Nov 03 17:16:28.588324 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.588092    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Nov 03 17:16:28.588324 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.587959    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Nov 03 17:16:28.588324 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.588199    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Nov 03 17:16:28.588324 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.587985    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 03 17:16:28.588324 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.588024    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Nov 03 17:16:28.588324 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.588149    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-d8tp8\""
Nov 03 17:16:28.600047 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.600028    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"]
Nov 03 17:16:28.600152 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.600139    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-thckz"
Nov 03 17:16:28.600735 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.600714    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 03 17:16:28.600870 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.600856    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Nov 03 17:16:28.600935 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.600918    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 03 17:16:28.601150 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.601135    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Nov 03 17:16:28.622568 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.622550    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Nov 03 17:16:28.622661 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.622578    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Nov 03 17:16:28.622717 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.622680    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Nov 03 17:16:28.622760 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.622712    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Nov 03 17:16:28.624146 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.624130    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-lb8nj"]
Nov 03 17:16:28.624276 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.624264    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:28.638509 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.638489    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-stats-auth\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:28.638603 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.638526    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlrxg\" (UniqueName: \"kubernetes.io/projected/12b0e63f-73f7-429a-879d-617267cc5f36-kube-api-access-nlrxg\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:28.638603 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.638541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-installation-pull-secrets\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.638603 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.638559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e4451ce6-8729-4567-9e85-d5eba0db6139-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:28.638721 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.638641    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8ea83f1f-61e7-4236-a5e7-08c079de313b-snapshots\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.638721 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.638658    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:28.638788 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.638717    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhp4d\" (UniqueName: \"kubernetes.io/projected/cf675d26-93c5-4a45-90db-7f95e260ac30-kube-api-access-mhp4d\") pod \"kas-connection-checker-685895c7c9-8dw9x\" (UID: \"cf675d26-93c5-4a45-90db-7f95e260ac30\") " pod="kube-system/kas-connection-checker-685895c7c9-8dw9x"
Nov 03 17:16:28.638788 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.638769    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ea83f1f-61e7-4236-a5e7-08c079de313b-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.638867 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.638789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp26q\" (UniqueName: \"kubernetes.io/projected/951f5784-32a9-40a3-b503-33249c04d5fc-kube-api-access-jp26q\") pod \"kas-connection-checker-685895c7c9-vgvw9\" (UID: \"951f5784-32a9-40a3-b503-33249c04d5fc\") " pod="kube-system/kas-connection-checker-685895c7c9-vgvw9"
Nov 03 17:16:28.638867 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.638804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-config\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:28.638867 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.638819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ea83f1f-61e7-4236-a5e7-08c079de313b-service-ca-bundle\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.638867 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.638838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-default-certificate\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:28.638867 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.638856    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w6wx\" (UniqueName: \"kubernetes.io/projected/749ecc85-b28a-4ecd-aaf0-27de9c332713-kube-api-access-5w6wx\") pod \"kas-connection-checker-685895c7c9-kpfdx\" (UID: \"749ecc85-b28a-4ecd-aaf0-27de9c332713\") " pod="kube-system/kas-connection-checker-685895c7c9-kpfdx"
Nov 03 17:16:28.639031 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.638969    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-trusted-ca\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:28.639134 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sb99\" (UniqueName: \"kubernetes.io/projected/7ba6ecd5-1d02-4433-b245-1c957827467e-kube-api-access-2sb99\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-btzt2\" (UID: \"7ba6ecd5-1d02-4433-b245-1c957827467e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"
Nov 03 17:16:28.639175 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639154    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-certificates\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.639217 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639184    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:28.639273 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639214    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ea83f1f-61e7-4236-a5e7-08c079de313b-serving-cert\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.639310 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639291    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-bound-sa-token\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.639372 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639354    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32072064-dcf7-4c58-a5ef-47eeadb245e5-serving-cert\") pod \"service-ca-operator-544d749c8c-kscd2\" (UID: \"32072064-dcf7-4c58-a5ef-47eeadb245e5\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"
Nov 03 17:16:28.639416 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639395    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27s7f\" (UniqueName: \"kubernetes.io/projected/32072064-dcf7-4c58-a5ef-47eeadb245e5-kube-api-access-27s7f\") pod \"service-ca-operator-544d749c8c-kscd2\" (UID: \"32072064-dcf7-4c58-a5ef-47eeadb245e5\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"
Nov 03 17:16:28.639461 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zkk6\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-kube-api-access-2zkk6\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.639523 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639503    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-image-registry-private-configuration\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.639558 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639514    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-config\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:28.639606 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639550    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-serving-cert\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:28.639606 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639576    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:28.639606 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp727\" (UniqueName: \"kubernetes.io/projected/e4451ce6-8729-4567-9e85-d5eba0db6139-kube-api-access-mp727\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:28.639751 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32072064-dcf7-4c58-a5ef-47eeadb245e5-config\") pod \"service-ca-operator-544d749c8c-kscd2\" (UID: \"32072064-dcf7-4c58-a5ef-47eeadb245e5\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"
Nov 03 17:16:28.639751 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/836fc8fa-ebbb-4836-b453-2b9be6db8452-ca-trust-extracted\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.639840 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ba6ecd5-1d02-4433-b245-1c957827467e-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-btzt2\" (UID: \"7ba6ecd5-1d02-4433-b245-1c957827467e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"
Nov 03 17:16:28.639840 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639769    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ea83f1f-61e7-4236-a5e7-08c079de313b-tmp\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.639974 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-trusted-ca\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.639974 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.640073 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.639995    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqqmv\" (UniqueName: \"kubernetes.io/projected/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-kube-api-access-pqqmv\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:28.640073 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.640029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ba6ecd5-1d02-4433-b245-1c957827467e-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-btzt2\" (UID: \"7ba6ecd5-1d02-4433-b245-1c957827467e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"
Nov 03 17:16:28.640073 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.640047    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-trusted-ca\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:28.640073 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.640056    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mbh7\" (UniqueName: \"kubernetes.io/projected/8ea83f1f-61e7-4236-a5e7-08c079de313b-kube-api-access-8mbh7\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.640529 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.640512    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ba6ecd5-1d02-4433-b245-1c957827467e-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-btzt2\" (UID: \"7ba6ecd5-1d02-4433-b245-1c957827467e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"
Nov 03 17:16:28.644028 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.644011    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ba6ecd5-1d02-4433-b245-1c957827467e-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-btzt2\" (UID: \"7ba6ecd5-1d02-4433-b245-1c957827467e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"
Nov 03 17:16:28.644136 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.644115    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-serving-cert\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:28.646433 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.646418    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5599885c48-cn2ff"]
Nov 03 17:16:28.646559 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.646543    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lb8nj"
Nov 03 17:16:28.653164 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.653140    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Nov 03 17:16:28.653273 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.653221    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Nov 03 17:16:28.663252 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.663218    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gstrl"]
Nov 03 17:16:28.663359 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.663344    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.677167 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.677149    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Nov 03 17:16:28.677498 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.677485    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Nov 03 17:16:28.677559 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.677549    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-l2mxr\""
Nov 03 17:16:28.679430 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.679417    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j4bd8"]
Nov 03 17:16:28.679501 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.679490    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gstrl"
Nov 03 17:16:28.699220 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.699197    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-68gjk\""
Nov 03 17:16:28.700543 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.700516    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhp4d\" (UniqueName: \"kubernetes.io/projected/cf675d26-93c5-4a45-90db-7f95e260ac30-kube-api-access-mhp4d\") pod \"kas-connection-checker-685895c7c9-8dw9x\" (UID: \"cf675d26-93c5-4a45-90db-7f95e260ac30\") " pod="kube-system/kas-connection-checker-685895c7c9-8dw9x"
Nov 03 17:16:28.700647 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.700516    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w6wx\" (UniqueName: \"kubernetes.io/projected/749ecc85-b28a-4ecd-aaf0-27de9c332713-kube-api-access-5w6wx\") pod \"kas-connection-checker-685895c7c9-kpfdx\" (UID: \"749ecc85-b28a-4ecd-aaf0-27de9c332713\") " pod="kube-system/kas-connection-checker-685895c7c9-kpfdx"
Nov 03 17:16:28.700647 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.700525    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sb99\" (UniqueName: \"kubernetes.io/projected/7ba6ecd5-1d02-4433-b245-1c957827467e-kube-api-access-2sb99\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-btzt2\" (UID: \"7ba6ecd5-1d02-4433-b245-1c957827467e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"
Nov 03 17:16:28.700647 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.700636    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp26q\" (UniqueName: \"kubernetes.io/projected/951f5784-32a9-40a3-b503-33249c04d5fc-kube-api-access-jp26q\") pod \"kas-connection-checker-685895c7c9-vgvw9\" (UID: \"951f5784-32a9-40a3-b503-33249c04d5fc\") " pod="kube-system/kas-connection-checker-685895c7c9-vgvw9"
Nov 03 17:16:28.700964 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.700945    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqqmv\" (UniqueName: \"kubernetes.io/projected/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-kube-api-access-pqqmv\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:28.703516 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703497    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-vgvw9"]
Nov 03 17:16:28.703587 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703526    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-8dw9x"]
Nov 03 17:16:28.703587 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703547    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"]
Nov 03 17:16:28.703587 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703569    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-kpfdx"]
Nov 03 17:16:28.703587 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703587    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"]
Nov 03 17:16:28.703717 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703609    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"]
Nov 03 17:16:28.703717 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703613    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:28.703717 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703631    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-vsdc5"]
Nov 03 17:16:28.703717 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703651    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-678bd9c4d9-wrhq6"]
Nov 03 17:16:28.703717 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703683    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c98dd6d65-rjtsq"]
Nov 03 17:16:28.703717 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703703    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"]
Nov 03 17:16:28.703926 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703725    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5599885c48-cn2ff"]
Nov 03 17:16:28.703926 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703745    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gstrl"]
Nov 03 17:16:28.703926 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703767    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-lb8nj"]
Nov 03 17:16:28.703926 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703788    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-thckz"]
Nov 03 17:16:28.703926 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703809    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"]
Nov 03 17:16:28.703926 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703833    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"]
Nov 03 17:16:28.703926 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.703852    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j4bd8"]
Nov 03 17:16:28.716572 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.716555    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nmhc2\""
Nov 03 17:16:28.726733 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.726716    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-8dw9x"
Nov 03 17:16:28.732476 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.732459    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 03 17:16:28.732476 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.732467    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gnkq2\""
Nov 03 17:16:28.732587 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.732499    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 03 17:16:28.732587 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.732510    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 03 17:16:28.741144 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-default-certificate\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:28.741188 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741154    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-trusted-ca\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.741188 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741174    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:28.741275 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdnwh\" (UniqueName: \"kubernetes.io/projected/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-kube-api-access-kdnwh\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:28.741312 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-certificates\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.741342 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741304    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.741342 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741335    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10a6a241-8eef-4bf1-b609-dd71d2042646-ca-trust-extracted\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.741411 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:28.741475 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ea83f1f-61e7-4236-a5e7-08c079de313b-serving-cert\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.741533 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:28.741485    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:28.741585 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:28.741541    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls podName:e4451ce6-8729-4567-9e85-d5eba0db6139 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:29.241522154 +0000 UTC m=+33.296246301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2wbdt" (UID: "e4451ce6-8729-4567-9e85-d5eba0db6139") : secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:28.741585 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741562    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-bound-sa-token\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.741689 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32072064-dcf7-4c58-a5ef-47eeadb245e5-serving-cert\") pod \"service-ca-operator-544d749c8c-kscd2\" (UID: \"32072064-dcf7-4c58-a5ef-47eeadb245e5\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"
Nov 03 17:16:28.741689 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27s7f\" (UniqueName: \"kubernetes.io/projected/32072064-dcf7-4c58-a5ef-47eeadb245e5-kube-api-access-27s7f\") pod \"service-ca-operator-544d749c8c-kscd2\" (UID: \"32072064-dcf7-4c58-a5ef-47eeadb245e5\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"
Nov 03 17:16:28.741689 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zkk6\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-kube-api-access-2zkk6\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.741826 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-image-registry-private-configuration\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.741826 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-nginx-conf\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:28.741826 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741768    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:28.741826 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741793    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp727\" (UniqueName: \"kubernetes.io/projected/e4451ce6-8729-4567-9e85-d5eba0db6139-kube-api-access-mp727\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:28.741826 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741810    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-certificates\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.741826 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741822    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6q9p\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-kube-api-access-h6q9p\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.742013 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741860    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmd2h\" (UniqueName: \"kubernetes.io/projected/69f0b08a-743a-441e-815c-015bcd833058-kube-api-access-vmd2h\") pod \"network-check-source-6f78d59f99-lb8nj\" (UID: \"69f0b08a-743a-441e-815c-015bcd833058\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lb8nj"
Nov 03 17:16:28.742013 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741897    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32072064-dcf7-4c58-a5ef-47eeadb245e5-config\") pod \"service-ca-operator-544d749c8c-kscd2\" (UID: \"32072064-dcf7-4c58-a5ef-47eeadb245e5\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"
Nov 03 17:16:28.742013 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:28.741923    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 03 17:16:28.742013 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:28.741973    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs podName:12b0e63f-73f7-429a-879d-617267cc5f36 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:29.241956573 +0000 UTC m=+33.296680743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs") pod "router-default-678bd9c4d9-wrhq6" (UID: "12b0e63f-73f7-429a-879d-617267cc5f36") : secret "router-metrics-certs-default" not found
Nov 03 17:16:28.742013 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.741923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:28.742251 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742053    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/836fc8fa-ebbb-4836-b453-2b9be6db8452-ca-trust-extracted\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.742251 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-certificates\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.742251 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ea83f1f-61e7-4236-a5e7-08c079de313b-tmp\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.742251 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742119    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-trusted-ca\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.742251 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742149    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.742251 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742194    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-installation-pull-secrets\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.742251 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742214    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-bound-sa-token\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.742251 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:28.742242    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:28.742251 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:28.742255    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c98dd6d65-rjtsq: secret "image-registry-tls" not found
Nov 03 17:16:28.742709 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742272    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mbh7\" (UniqueName: \"kubernetes.io/projected/8ea83f1f-61e7-4236-a5e7-08c079de313b-kube-api-access-8mbh7\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.742709 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:28.742294    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls podName:836fc8fa-ebbb-4836-b453-2b9be6db8452 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:29.242280728 +0000 UTC m=+33.297004890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls") pod "image-registry-7c98dd6d65-rjtsq" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452") : secret "image-registry-tls" not found
Nov 03 17:16:28.742709 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742324    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-stats-auth\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:28.742709 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlrxg\" (UniqueName: \"kubernetes.io/projected/12b0e63f-73f7-429a-879d-617267cc5f36-kube-api-access-nlrxg\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:28.742709 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-installation-pull-secrets\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.742709 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742427    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mmd9\" (UniqueName: \"kubernetes.io/projected/a43a3fa1-f14d-4abc-95bb-1a1f21f25b01-kube-api-access-4mmd9\") pod \"volume-data-source-validator-58c9f5f46d-thckz\" (UID: \"a43a3fa1-f14d-4abc-95bb-1a1f21f25b01\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-thckz"
Nov 03 17:16:28.742709 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e4451ce6-8729-4567-9e85-d5eba0db6139-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:28.742709 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742486    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8ea83f1f-61e7-4236-a5e7-08c079de313b-snapshots\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.742709 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:28.742709 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742542    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-image-registry-private-configuration\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.742709 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ea83f1f-61e7-4236-a5e7-08c079de313b-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.742709 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742622    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:28.742709 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742657    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ea83f1f-61e7-4236-a5e7-08c079de313b-service-ca-bundle\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.744080 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.742759    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32072064-dcf7-4c58-a5ef-47eeadb245e5-config\") pod \"service-ca-operator-544d749c8c-kscd2\" (UID: \"32072064-dcf7-4c58-a5ef-47eeadb245e5\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"
Nov 03 17:16:28.744080 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.743263    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ea83f1f-61e7-4236-a5e7-08c079de313b-service-ca-bundle\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.744080 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.743959    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ea83f1f-61e7-4236-a5e7-08c079de313b-tmp\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.744448 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.744248    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/836fc8fa-ebbb-4836-b453-2b9be6db8452-ca-trust-extracted\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.744448 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.744334    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-trusted-ca\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.744448 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.744399    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32072064-dcf7-4c58-a5ef-47eeadb245e5-serving-cert\") pod \"service-ca-operator-544d749c8c-kscd2\" (UID: \"32072064-dcf7-4c58-a5ef-47eeadb245e5\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"
Nov 03 17:16:28.744910 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.744885    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqzh_f11f9269-8c8d-43da-a7f6-c766c17793c4/konnectivity-agent/0.log" limit=1024
Nov 03 17:16:28.745020 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.744935    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-default-certificate\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:28.745289 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.745268    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-image-registry-private-configuration\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.745378 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.745346    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ea83f1f-61e7-4236-a5e7-08c079de313b-serving-cert\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.745505 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:28.745490    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle podName:12b0e63f-73f7-429a-879d-617267cc5f36 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:29.245470927 +0000 UTC m=+33.300195087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle") pod "router-default-678bd9c4d9-wrhq6" (UID: "12b0e63f-73f7-429a-879d-617267cc5f36") : configmap references non-existent config key: service-ca.crt
Nov 03 17:16:28.745605 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.745583    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8ea83f1f-61e7-4236-a5e7-08c079de313b-snapshots\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.745728 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.745712    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-installation-pull-secrets\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.745763 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.745722    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ea83f1f-61e7-4236-a5e7-08c079de313b-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.746358 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.746341    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e4451ce6-8729-4567-9e85-d5eba0db6139-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:28.746997 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.746975    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-stats-auth\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:28.756036 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.756017    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-kpfdx"
Nov 03 17:16:28.756329 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.756306    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 03 17:16:28.756329 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.756312    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 03 17:16:28.756483 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.756441    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qk7gm\""
Nov 03 17:16:28.793908 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.793882    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:28.805610 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.805567    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27s7f\" (UniqueName: \"kubernetes.io/projected/32072064-dcf7-4c58-a5ef-47eeadb245e5-kube-api-access-27s7f\") pod \"service-ca-operator-544d749c8c-kscd2\" (UID: \"32072064-dcf7-4c58-a5ef-47eeadb245e5\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"
Nov 03 17:16:28.805841 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.805820    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mbh7\" (UniqueName: \"kubernetes.io/projected/8ea83f1f-61e7-4236-a5e7-08c079de313b-kube-api-access-8mbh7\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.807374 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.807347    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zkk6\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-kube-api-access-2zkk6\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.807533 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.807509    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-bound-sa-token\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:28.807777 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.807757    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlrxg\" (UniqueName: \"kubernetes.io/projected/12b0e63f-73f7-429a-879d-617267cc5f36-kube-api-access-nlrxg\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:28.808424 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.808403    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp727\" (UniqueName: \"kubernetes.io/projected/e4451ce6-8729-4567-9e85-d5eba0db6139-kube-api-access-mp727\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:28.814457 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.814435    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"
Nov 03 17:16:28.847459 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.844065    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-trusted-ca\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.847459 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.844106    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:28.847459 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.844132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdnwh\" (UniqueName: \"kubernetes.io/projected/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-kube-api-access-kdnwh\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:28.847459 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.844162    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.847459 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.844189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10a6a241-8eef-4bf1-b609-dd71d2042646-ca-trust-extracted\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.847459 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:28.844402    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 03 17:16:28.847459 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.845364    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-trusted-ca\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.847459 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:28.845771    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:28.847459 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:28.845788    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5599885c48-cn2ff: secret "image-registry-tls" not found
Nov 03 17:16:28.847459 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.847296    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10a6a241-8eef-4bf1-b609-dd71d2042646-ca-trust-extracted\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.864776 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:28.851288    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls podName:1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:29.351256547 +0000 UTC m=+33.405980706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-mgljp" (UID: "1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66") : secret "samples-operator-tls" not found
Nov 03 17:16:28.864776 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:28.851338    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls podName:10a6a241-8eef-4bf1-b609-dd71d2042646 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:29.351326458 +0000 UTC m=+33.406050609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls") pod "image-registry-5599885c48-cn2ff" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646") : secret "image-registry-tls" not found
Nov 03 17:16:28.864776 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.851391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2e4d96-73c8-4a18-b4f7-97387ed44645-tmp-dir\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:28.864776 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.851433    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-nginx-conf\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:28.864776 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.851521    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xhtw\" (UniqueName: \"kubernetes.io/projected/2f2e4d96-73c8-4a18-b4f7-97387ed44645-kube-api-access-4xhtw\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:28.864776 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.851546    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh6ft\" (UniqueName: \"kubernetes.io/projected/2ef0f942-8c3c-43c9-bc45-a40b69188935-kube-api-access-mh6ft\") pod \"ingress-canary-gstrl\" (UID: \"2ef0f942-8c3c-43c9-bc45-a40b69188935\") " pod="openshift-ingress-canary/ingress-canary-gstrl"
Nov 03 17:16:28.864776 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.851593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6q9p\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-kube-api-access-h6q9p\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.864776 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.851623    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmd2h\" (UniqueName: \"kubernetes.io/projected/69f0b08a-743a-441e-815c-015bcd833058-kube-api-access-vmd2h\") pod \"network-check-source-6f78d59f99-lb8nj\" (UID: \"69f0b08a-743a-441e-815c-015bcd833058\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lb8nj"
Nov 03 17:16:28.864776 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.851660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:28.864776 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.851690    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-certificates\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.864776 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.851740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ef0f942-8c3c-43c9-bc45-a40b69188935-cert\") pod \"ingress-canary-gstrl\" (UID: \"2ef0f942-8c3c-43c9-bc45-a40b69188935\") " pod="openshift-ingress-canary/ingress-canary-gstrl"
Nov 03 17:16:28.864776 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.851776    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-installation-pull-secrets\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.864776 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.851800    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-bound-sa-token\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.864776 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.851849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mmd9\" (UniqueName: \"kubernetes.io/projected/a43a3fa1-f14d-4abc-95bb-1a1f21f25b01-kube-api-access-4mmd9\") pod \"volume-data-source-validator-58c9f5f46d-thckz\" (UID: \"a43a3fa1-f14d-4abc-95bb-1a1f21f25b01\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-thckz"
Nov 03 17:16:28.865585 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.851872    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:28.865585 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.851935    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-image-registry-private-configuration\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.865585 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.851964    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2f2e4d96-73c8-4a18-b4f7-97387ed44645-config-volume\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:28.865585 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.852004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:28.865585 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.852895    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:28.865585 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.853731    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-nginx-conf\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:28.865585 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:28.854445    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 03 17:16:28.865585 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:28.854567    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert podName:0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:29.354549637 +0000 UTC m=+33.409273795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-jmrx4" (UID: "0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3") : secret "networking-console-plugin-cert" not found
Nov 03 17:16:28.865585 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.855104    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-certificates\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.865585 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.858843    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-installation-pull-secrets\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.865585 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.862027    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-image-registry-private-configuration\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.871695 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.871509    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"
Nov 03 17:16:28.892688 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.892046    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:28.908884 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.908255    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdnwh\" (UniqueName: \"kubernetes.io/projected/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-kube-api-access-kdnwh\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:28.916844 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.916822    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6q9p\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-kube-api-access-h6q9p\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.920767 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.920348    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmd2h\" (UniqueName: \"kubernetes.io/projected/69f0b08a-743a-441e-815c-015bcd833058-kube-api-access-vmd2h\") pod \"network-check-source-6f78d59f99-lb8nj\" (UID: \"69f0b08a-743a-441e-815c-015bcd833058\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lb8nj"
Nov 03 17:16:28.920767 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.920730    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mmd9\" (UniqueName: \"kubernetes.io/projected/a43a3fa1-f14d-4abc-95bb-1a1f21f25b01-kube-api-access-4mmd9\") pod \"volume-data-source-validator-58c9f5f46d-thckz\" (UID: \"a43a3fa1-f14d-4abc-95bb-1a1f21f25b01\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-thckz"
Nov 03 17:16:28.922930 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.922909    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-bound-sa-token\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:28.953558 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.953525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2e4d96-73c8-4a18-b4f7-97387ed44645-tmp-dir\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:28.953641 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.953583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xhtw\" (UniqueName: \"kubernetes.io/projected/2f2e4d96-73c8-4a18-b4f7-97387ed44645-kube-api-access-4xhtw\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:28.953641 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.953608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh6ft\" (UniqueName: \"kubernetes.io/projected/2ef0f942-8c3c-43c9-bc45-a40b69188935-kube-api-access-mh6ft\") pod \"ingress-canary-gstrl\" (UID: \"2ef0f942-8c3c-43c9-bc45-a40b69188935\") " pod="openshift-ingress-canary/ingress-canary-gstrl"
Nov 03 17:16:28.953720 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.953704    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ef0f942-8c3c-43c9-bc45-a40b69188935-cert\") pod \"ingress-canary-gstrl\" (UID: \"2ef0f942-8c3c-43c9-bc45-a40b69188935\") " pod="openshift-ingress-canary/ingress-canary-gstrl"
Nov 03 17:16:28.953769 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.953756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:28.953810 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.953799    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2f2e4d96-73c8-4a18-b4f7-97387ed44645-config-volume\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:28.954269 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.954247    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2f2e4d96-73c8-4a18-b4f7-97387ed44645-config-volume\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:28.955040 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.955019    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2e4d96-73c8-4a18-b4f7-97387ed44645-tmp-dir\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:28.955594 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:28.955576    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 17:16:28.955652 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:28.955621    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls podName:2f2e4d96-73c8-4a18-b4f7-97387ed44645 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:29.455608957 +0000 UTC m=+33.510333100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls") pod "dns-default-j4bd8" (UID: "2f2e4d96-73c8-4a18-b4f7-97387ed44645") : secret "dns-default-metrics-tls" not found
Nov 03 17:16:28.957820 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.957800    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ef0f942-8c3c-43c9-bc45-a40b69188935-cert\") pod \"ingress-canary-gstrl\" (UID: \"2ef0f942-8c3c-43c9-bc45-a40b69188935\") " pod="openshift-ingress-canary/ingress-canary-gstrl"
Nov 03 17:16:28.998976 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:28.998917    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-vgvw9"
Nov 03 17:16:29.016652 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.016627    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-thckz"
Nov 03 17:16:29.016985 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.016966    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xhtw\" (UniqueName: \"kubernetes.io/projected/2f2e4d96-73c8-4a18-b4f7-97387ed44645-kube-api-access-4xhtw\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:29.017074 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.017002    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh6ft\" (UniqueName: \"kubernetes.io/projected/2ef0f942-8c3c-43c9-bc45-a40b69188935-kube-api-access-mh6ft\") pod \"ingress-canary-gstrl\" (UID: \"2ef0f942-8c3c-43c9-bc45-a40b69188935\") " pod="openshift-ingress-canary/ingress-canary-gstrl"
Nov 03 17:16:29.072517 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.072483    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lb8nj"
Nov 03 17:16:29.106851 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.106829    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gstrl"
Nov 03 17:16:29.174675 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.174645    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-kpfdx"]
Nov 03 17:16:29.178164 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.177909    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-8dw9x"]
Nov 03 17:16:29.179835 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:16:29.179804    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod749ecc85_b28a_4ecd_aaf0_27de9c332713.slice/crio-d508448c01a0f15eb1f320f61b04eced18c10e700cc324c4398f462b85d670e2 WatchSource:0}: Error finding container d508448c01a0f15eb1f320f61b04eced18c10e700cc324c4398f462b85d670e2: Status 404 returned error can't find the container with id d508448c01a0f15eb1f320f61b04eced18c10e700cc324c4398f462b85d670e2
Nov 03 17:16:29.185875 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:16:29.185855    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf675d26_93c5_4a45_90db_7f95e260ac30.slice/crio-6dc5e5141ce62779dacf4f2744a06ba9e1a17a6654025330954645ba85d67a52 WatchSource:0}: Error finding container 6dc5e5141ce62779dacf4f2744a06ba9e1a17a6654025330954645ba85d67a52: Status 404 returned error can't find the container with id 6dc5e5141ce62779dacf4f2744a06ba9e1a17a6654025330954645ba85d67a52
Nov 03 17:16:29.213400 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:16:29.213362    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0caf85ea_1bec_4670_a2e1_3cafd0e5a587.slice/crio-182ee7d4156bcaaadb6e5e265c14fc1918dbc7868aa56cbb7dc5ec0254b5b48b WatchSource:0}: Error finding container 182ee7d4156bcaaadb6e5e265c14fc1918dbc7868aa56cbb7dc5ec0254b5b48b: Status 404 returned error can't find the container with id 182ee7d4156bcaaadb6e5e265c14fc1918dbc7868aa56cbb7dc5ec0254b5b48b
Nov 03 17:16:29.218380 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.218356    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"]
Nov 03 17:16:29.223040 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.222538    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"]
Nov 03 17:16:29.230418 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:16:29.230389    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32072064_dcf7_4c58_a5ef_47eeadb245e5.slice/crio-39089e125d6e2237461529f1ba3bbd05b228a3e102e55a4ac8adf75c8472de14 WatchSource:0}: Error finding container 39089e125d6e2237461529f1ba3bbd05b228a3e102e55a4ac8adf75c8472de14: Status 404 returned error can't find the container with id 39089e125d6e2237461529f1ba3bbd05b228a3e102e55a4ac8adf75c8472de14
Nov 03 17:16:29.256120 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.256096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:29.256587 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.256145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:29.256587 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.256180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:29.256587 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.256219    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:29.256587 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:29.256278    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:29.256587 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:29.256303    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 03 17:16:29.256587 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:29.256356    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls podName:e4451ce6-8729-4567-9e85-d5eba0db6139 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:30.256332155 +0000 UTC m=+34.311056299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2wbdt" (UID: "e4451ce6-8729-4567-9e85-d5eba0db6139") : secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:29.256587 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:29.256371    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:29.256587 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:29.256376    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs podName:12b0e63f-73f7-429a-879d-617267cc5f36 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:30.256365915 +0000 UTC m=+34.311090062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs") pod "router-default-678bd9c4d9-wrhq6" (UID: "12b0e63f-73f7-429a-879d-617267cc5f36") : secret "router-metrics-certs-default" not found
Nov 03 17:16:29.256587 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:29.256381    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c98dd6d65-rjtsq: secret "image-registry-tls" not found
Nov 03 17:16:29.256587 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:29.256395    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle podName:12b0e63f-73f7-429a-879d-617267cc5f36 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:30.256383801 +0000 UTC m=+34.311107949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle") pod "router-default-678bd9c4d9-wrhq6" (UID: "12b0e63f-73f7-429a-879d-617267cc5f36") : configmap references non-existent config key: service-ca.crt
Nov 03 17:16:29.256587 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:29.256414    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls podName:836fc8fa-ebbb-4836-b453-2b9be6db8452 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:30.256403707 +0000 UTC m=+34.311127851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls") pod "image-registry-7c98dd6d65-rjtsq" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452") : secret "image-registry-tls" not found
Nov 03 17:16:29.281935 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.281891    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"]
Nov 03 17:16:29.290786 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.290765    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-vsdc5"]
Nov 03 17:16:29.356907 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.356881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:29.357008 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.356978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:29.357055 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.357015    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:29.357113 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:29.357091    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 03 17:16:29.357113 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:29.357102    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 03 17:16:29.357178 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:29.357143    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls podName:1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:30.357131964 +0000 UTC m=+34.411856108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-mgljp" (UID: "1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66") : secret "samples-operator-tls" not found
Nov 03 17:16:29.357178 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:29.357159    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert podName:0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:30.357151994 +0000 UTC m=+34.411876138 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-jmrx4" (UID: "0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3") : secret "networking-console-plugin-cert" not found
Nov 03 17:16:29.357288 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:29.357204    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:29.357288 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:29.357241    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5599885c48-cn2ff: secret "image-registry-tls" not found
Nov 03 17:16:29.357360 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:29.357304    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls podName:10a6a241-8eef-4bf1-b609-dd71d2042646 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:30.357278351 +0000 UTC m=+34.412002494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls") pod "image-registry-5599885c48-cn2ff" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646") : secret "image-registry-tls" not found
Nov 03 17:16:29.410573 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.410541    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-vgvw9"]
Nov 03 17:16:29.413734 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:16:29.413701    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod951f5784_32a9_40a3_b503_33249c04d5fc.slice/crio-01fa94ee14816352d717f70b921db29a366f22bc7a92e77a4b829b1d6dbe48a3 WatchSource:0}: Error finding container 01fa94ee14816352d717f70b921db29a366f22bc7a92e77a4b829b1d6dbe48a3: Status 404 returned error can't find the container with id 01fa94ee14816352d717f70b921db29a366f22bc7a92e77a4b829b1d6dbe48a3
Nov 03 17:16:29.432182 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.432162    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-thckz"]
Nov 03 17:16:29.441307 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:16:29.441276    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda43a3fa1_f14d_4abc_95bb_1a1f21f25b01.slice/crio-db2144054853869ea8fea2b2ddadb92045e4d2e8447e0b7f99e0c85e1094b194 WatchSource:0}: Error finding container db2144054853869ea8fea2b2ddadb92045e4d2e8447e0b7f99e0c85e1094b194: Status 404 returned error can't find the container with id db2144054853869ea8fea2b2ddadb92045e4d2e8447e0b7f99e0c85e1094b194
Nov 03 17:16:29.457975 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.457946    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:29.458141 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:29.458124    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 17:16:29.458202 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:29.458179    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls podName:2f2e4d96-73c8-4a18-b4f7-97387ed44645 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:30.45816084 +0000 UTC m=+34.512884998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls") pod "dns-default-j4bd8" (UID: "2f2e4d96-73c8-4a18-b4f7-97387ed44645") : secret "dns-default-metrics-tls" not found
Nov 03 17:16:29.508544 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.508515    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-lb8nj"]
Nov 03 17:16:29.511347 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:16:29.511292    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69f0b08a_743a_441e_815c_015bcd833058.slice/crio-472ba7557e4d165c27da4a0eda01ae8b90cb3d6f686af8c9421a9e5373717633 WatchSource:0}: Error finding container 472ba7557e4d165c27da4a0eda01ae8b90cb3d6f686af8c9421a9e5373717633: Status 404 returned error can't find the container with id 472ba7557e4d165c27da4a0eda01ae8b90cb3d6f686af8c9421a9e5373717633
Nov 03 17:16:29.516328 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.516193    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gstrl"]
Nov 03 17:16:29.519782 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:16:29.519752    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef0f942_8c3c_43c9_bc45_a40b69188935.slice/crio-9785a3480d456a16bd34a23099a841ccf110d96d3f4d3ffb29fcd3e4ff56f216 WatchSource:0}: Error finding container 9785a3480d456a16bd34a23099a841ccf110d96d3f4d3ffb29fcd3e4ff56f216: Status 404 returned error can't find the container with id 9785a3480d456a16bd34a23099a841ccf110d96d3f4d3ffb29fcd3e4ff56f216
Nov 03 17:16:29.531030 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.531007    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2" event={"ID":"32072064-dcf7-4c58-a5ef-47eeadb245e5","Type":"ContainerStarted","Data":"39089e125d6e2237461529f1ba3bbd05b228a3e102e55a4ac8adf75c8472de14"}
Nov 03 17:16:29.532598 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.532579    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-thckz" event={"ID":"a43a3fa1-f14d-4abc-95bb-1a1f21f25b01","Type":"ContainerStarted","Data":"db2144054853869ea8fea2b2ddadb92045e4d2e8447e0b7f99e0c85e1094b194"}
Nov 03 17:16:29.533951 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.533930    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-vgvw9" event={"ID":"951f5784-32a9-40a3-b503-33249c04d5fc","Type":"ContainerStarted","Data":"d86f7b4d6468f9c473812a4c0a95946042a43180050be936f76266c867eed980"}
Nov 03 17:16:29.534011 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.533978    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-vgvw9" event={"ID":"951f5784-32a9-40a3-b503-33249c04d5fc","Type":"ContainerStarted","Data":"01fa94ee14816352d717f70b921db29a366f22bc7a92e77a4b829b1d6dbe48a3"}
Nov 03 17:16:29.535361 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.535339    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-kpfdx" event={"ID":"749ecc85-b28a-4ecd-aaf0-27de9c332713","Type":"ContainerStarted","Data":"9efacee6d7cc89c9084865a2b3e7004ce305a12d72e7aff5e752cad174ffd2e0"}
Nov 03 17:16:29.535459 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.535376    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-kpfdx" event={"ID":"749ecc85-b28a-4ecd-aaf0-27de9c332713","Type":"ContainerStarted","Data":"d508448c01a0f15eb1f320f61b04eced18c10e700cc324c4398f462b85d670e2"}
Nov 03 17:16:29.536502 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.536481    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lb8nj" event={"ID":"69f0b08a-743a-441e-815c-015bcd833058","Type":"ContainerStarted","Data":"472ba7557e4d165c27da4a0eda01ae8b90cb3d6f686af8c9421a9e5373717633"}
Nov 03 17:16:29.537611 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.537591    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2" event={"ID":"7ba6ecd5-1d02-4433-b245-1c957827467e","Type":"ContainerStarted","Data":"851332dd3e2ab2ef739da568ce61db14561db576d866181b80d8500e7948b47c"}
Nov 03 17:16:29.538665 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.538646    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gstrl" event={"ID":"2ef0f942-8c3c-43c9-bc45-a40b69188935","Type":"ContainerStarted","Data":"9785a3480d456a16bd34a23099a841ccf110d96d3f4d3ffb29fcd3e4ff56f216"}
Nov 03 17:16:29.539714 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.539694    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-vsdc5" event={"ID":"8ea83f1f-61e7-4236-a5e7-08c079de313b","Type":"ContainerStarted","Data":"dc1ded8268503c05969cb9d691fe4f9fb194693eeb55ce44ff4a14ff852cee73"}
Nov 03 17:16:29.540730 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.540711    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq" event={"ID":"0caf85ea-1bec-4670-a2e1-3cafd0e5a587","Type":"ContainerStarted","Data":"182ee7d4156bcaaadb6e5e265c14fc1918dbc7868aa56cbb7dc5ec0254b5b48b"}
Nov 03 17:16:29.542041 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.542017    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-8dw9x" event={"ID":"cf675d26-93c5-4a45-90db-7f95e260ac30","Type":"ContainerStarted","Data":"a0e55232074aba109658ee35496abd711931e4944445c6564bb01695d25b080c"}
Nov 03 17:16:29.542106 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:29.542052    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-8dw9x" event={"ID":"cf675d26-93c5-4a45-90db-7f95e260ac30","Type":"ContainerStarted","Data":"6dc5e5141ce62779dacf4f2744a06ba9e1a17a6654025330954645ba85d67a52"}
Nov 03 17:16:30.164762 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.164727    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:30.164906 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.164839    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 03 17:16:30.164906 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.164888    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs podName:26f7336a-a2b6-4f80-b417-a9a5d1648d69 nodeName:}" failed. No retries permitted until 2026-11-03 17:17:02.164875839 +0000 UTC m=+66.219599983 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs") pod "network-metrics-daemon-pvnlt" (UID: "26f7336a-a2b6-4f80-b417-a9a5d1648d69") : secret "metrics-daemon-secret" not found
Nov 03 17:16:30.252760 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.252725    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqzh_f11f9269-8c8d-43da-a7f6-c766c17793c4/konnectivity-agent/0.log" limit=1024
Nov 03 17:16:30.266026 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.265994    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:30.266465 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.266035    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87dpc\" (UniqueName: \"kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc\") pod \"network-check-target-s7n7v\" (UID: \"34d75159-9865-405a-88fe-5cf738813dde\") " pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:30.266465 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.266073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:30.266465 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.266139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:30.266465 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.266139    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:30.266465 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.266207    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:30.266465 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.266239    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c98dd6d65-rjtsq: secret "image-registry-tls" not found
Nov 03 17:16:30.266465 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.266250    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 03 17:16:30.266465 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.266264    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls podName:e4451ce6-8729-4567-9e85-d5eba0db6139 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:32.266247604 +0000 UTC m=+36.320971752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2wbdt" (UID: "e4451ce6-8729-4567-9e85-d5eba0db6139") : secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:30.266465 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.266290    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls podName:836fc8fa-ebbb-4836-b453-2b9be6db8452 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:32.266272409 +0000 UTC m=+36.320996565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls") pod "image-registry-7c98dd6d65-rjtsq" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452") : secret "image-registry-tls" not found
Nov 03 17:16:30.266465 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.266336    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs podName:12b0e63f-73f7-429a-879d-617267cc5f36 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:32.266319995 +0000 UTC m=+36.321044144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs") pod "router-default-678bd9c4d9-wrhq6" (UID: "12b0e63f-73f7-429a-879d-617267cc5f36") : secret "router-metrics-certs-default" not found
Nov 03 17:16:30.266465 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.266399    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:30.266465 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.266436    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:30.266927 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.266517    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle podName:12b0e63f-73f7-429a-879d-617267cc5f36 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:32.266503073 +0000 UTC m=+36.321227250 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle") pod "router-default-678bd9c4d9-wrhq6" (UID: "12b0e63f-73f7-429a-879d-617267cc5f36") : configmap references non-existent config key: service-ca.crt
Nov 03 17:16:30.268714 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.268692    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:30.268919 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.268900    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87dpc\" (UniqueName: \"kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc\") pod \"network-check-target-s7n7v\" (UID: \"34d75159-9865-405a-88fe-5cf738813dde\") " pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:30.274987 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.274968    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:30.348456 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.348423    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:30.367130 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.367098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:30.367294 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.367153    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:30.367294 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.367241    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:30.367294 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.367275    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 03 17:16:30.367439 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.367348    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls podName:1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:32.36732626 +0000 UTC m=+36.422050410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-mgljp" (UID: "1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66") : secret "samples-operator-tls" not found
Nov 03 17:16:30.367439 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.367406    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 03 17:16:30.367439 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.367425    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:30.367439 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.367436    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5599885c48-cn2ff: secret "image-registry-tls" not found
Nov 03 17:16:30.367581 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.367457    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert podName:0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:32.367442309 +0000 UTC m=+36.422166475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-jmrx4" (UID: "0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3") : secret "networking-console-plugin-cert" not found
Nov 03 17:16:30.367581 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.367475    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls podName:10a6a241-8eef-4bf1-b609-dd71d2042646 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:32.367465296 +0000 UTC m=+36.422189444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls") pod "image-registry-5599885c48-cn2ff" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646") : secret "image-registry-tls" not found
Nov 03 17:16:30.468777 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.468582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:30.468777 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.468711    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 17:16:30.468777 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:30.468765    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls podName:2f2e4d96-73c8-4a18-b4f7-97387ed44645 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:32.468751042 +0000 UTC m=+36.523475218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls") pod "dns-default-j4bd8" (UID: "2f2e4d96-73c8-4a18-b4f7-97387ed44645") : secret "dns-default-metrics-tls" not found
Nov 03 17:16:30.477553 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.477433    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqzh_f11f9269-8c8d-43da-a7f6-c766c17793c4/konnectivity-agent/0.log" limit=1024
Nov 03 17:16:30.579938 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.579880    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-vgvw9" podStartSLOduration=306.57986542 podStartE2EDuration="5m6.57986542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:11:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:30.578445575 +0000 UTC m=+34.633169753" watchObservedRunningTime="2026-11-03 17:16:30.57986542 +0000 UTC m=+34.634589586"
Nov 03 17:16:30.678500 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.678390    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s7n7v"]
Nov 03 17:16:30.683888 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:16:30.683853    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d75159_9865_405a_88fe_5cf738813dde.slice/crio-3a9d8a3ed6d1b22fb2e5162de99c708236e814e47812cc5d2ab98ca78ba11293 WatchSource:0}: Error finding container 3a9d8a3ed6d1b22fb2e5162de99c708236e814e47812cc5d2ab98ca78ba11293: Status 404 returned error can't find the container with id 3a9d8a3ed6d1b22fb2e5162de99c708236e814e47812cc5d2ab98ca78ba11293
Nov 03 17:16:30.749704 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.749632    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-8dw9x" podStartSLOduration=306.749612705 podStartE2EDuration="5m6.749612705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:11:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:30.698164321 +0000 UTC m=+34.752888489" watchObservedRunningTime="2026-11-03 17:16:30.749612705 +0000 UTC m=+34.804336871"
Nov 03 17:16:30.750556 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.750530    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cfrm8"]
Nov 03 17:16:30.821407 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:30.821196    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-kpfdx" podStartSLOduration=306.821174943 podStartE2EDuration="5m6.821174943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:11:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:30.819747525 +0000 UTC m=+34.874471704" watchObservedRunningTime="2026-11-03 17:16:30.821174943 +0000 UTC m=+34.875899110"
Nov 03 17:16:31.554428 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:31.554366    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cfrm8" event={"ID":"10d51151-30e6-4c36-a13b-5af9c5ba56e8","Type":"ContainerStarted","Data":"3a671b0882cfc6d4e2490726bb229dc55d2acd6ef7a4395c73d20862b450f2a9"}
Nov 03 17:16:31.557443 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:31.557413    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s7n7v" event={"ID":"34d75159-9865-405a-88fe-5cf738813dde","Type":"ContainerStarted","Data":"3a9d8a3ed6d1b22fb2e5162de99c708236e814e47812cc5d2ab98ca78ba11293"}
Nov 03 17:16:32.286726 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:32.286685    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:32.286912 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:32.286802    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:32.286912 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:32.286857    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:32.287033 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:32.286918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:32.287098 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:32.287086    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:32.287157 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:32.287102    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c98dd6d65-rjtsq: secret "image-registry-tls" not found
Nov 03 17:16:32.287208 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:32.287157    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls podName:836fc8fa-ebbb-4836-b453-2b9be6db8452 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:36.287140042 +0000 UTC m=+40.341864190 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls") pod "image-registry-7c98dd6d65-rjtsq" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452") : secret "image-registry-tls" not found
Nov 03 17:16:32.287617 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:32.287598    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle podName:12b0e63f-73f7-429a-879d-617267cc5f36 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:36.287580937 +0000 UTC m=+40.342305087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle") pod "router-default-678bd9c4d9-wrhq6" (UID: "12b0e63f-73f7-429a-879d-617267cc5f36") : configmap references non-existent config key: service-ca.crt
Nov 03 17:16:32.287701 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:32.287683    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:32.287761 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:32.287717    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls podName:e4451ce6-8729-4567-9e85-d5eba0db6139 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:36.287707063 +0000 UTC m=+40.342431208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2wbdt" (UID: "e4451ce6-8729-4567-9e85-d5eba0db6139") : secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:32.287816 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:32.287772    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 03 17:16:32.287816 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:32.287804    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs podName:12b0e63f-73f7-429a-879d-617267cc5f36 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:36.287794186 +0000 UTC m=+40.342518337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs") pod "router-default-678bd9c4d9-wrhq6" (UID: "12b0e63f-73f7-429a-879d-617267cc5f36") : secret "router-metrics-certs-default" not found
Nov 03 17:16:32.387561 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:32.387526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:32.387698 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:32.387595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:32.387698 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:32.387678    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:32.387868 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:32.387808    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 03 17:16:32.387919 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:32.387868    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert podName:0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:36.387850624 +0000 UTC m=+40.442574783 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-jmrx4" (UID: "0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3") : secret "networking-console-plugin-cert" not found
Nov 03 17:16:32.387986 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:32.387943    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 03 17:16:32.387986 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:32.387977    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls podName:1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:36.387966405 +0000 UTC m=+40.442690566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-mgljp" (UID: "1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66") : secret "samples-operator-tls" not found
Nov 03 17:16:32.388082 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:32.388054    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:32.388082 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:32.388067    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5599885c48-cn2ff: secret "image-registry-tls" not found
Nov 03 17:16:32.388180 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:32.388099    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls podName:10a6a241-8eef-4bf1-b609-dd71d2042646 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:36.388089051 +0000 UTC m=+40.442813208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls") pod "image-registry-5599885c48-cn2ff" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646") : secret "image-registry-tls" not found
Nov 03 17:16:32.489011 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:32.488663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:32.489011 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:32.488846    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 17:16:32.489011 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:32.488932    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls podName:2f2e4d96-73c8-4a18-b4f7-97387ed44645 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:36.48891155 +0000 UTC m=+40.543635716 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls") pod "dns-default-j4bd8" (UID: "2f2e4d96-73c8-4a18-b4f7-97387ed44645") : secret "dns-default-metrics-tls" not found
Nov 03 17:16:32.563856 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:32.563778    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-thckz" event={"ID":"a43a3fa1-f14d-4abc-95bb-1a1f21f25b01","Type":"ContainerStarted","Data":"1ef4cb609100e4d7a7e99ac2a88db511a0a32d61b74c43814e235f1fe33f6065"}
Nov 03 17:16:32.684815 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:32.684750    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-thckz" podStartSLOduration=288.739271337 podStartE2EDuration="4m51.684729991s" totalImagesPullingTime="2.945458654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:32.682898874 +0000 UTC m=+36.737623042" watchObservedRunningTime="2026-11-03 17:16:32.684729991 +0000 UTC m=+36.739454156"
Nov 03 17:16:32.861131 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:32.861046    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqzh_f11f9269-8c8d-43da-a7f6-c766c17793c4/konnectivity-agent/0.log" limit=1024
Nov 03 17:16:33.128969 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:33.128874    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjqzh_f11f9269-8c8d-43da-a7f6-c766c17793c4/konnectivity-agent/0.log" limit=1024
Nov 03 17:16:34.577607 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:34.577573    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/0.log"
Nov 03 17:16:34.577970 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:34.577613    2576 generic.go:356] "Generic (PLEG): container finished" podID="0caf85ea-1bec-4670-a2e1-3cafd0e5a587" containerID="e3e42dd2ae422ef872dae5d4360f6d7dc989f9134e7b064ff96e490413e5e8d4" exitCode=255
Nov 03 17:16:34.577970 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:34.577645    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq" event={"ID":"0caf85ea-1bec-4670-a2e1-3cafd0e5a587","Type":"ContainerDied","Data":"e3e42dd2ae422ef872dae5d4360f6d7dc989f9134e7b064ff96e490413e5e8d4"}
Nov 03 17:16:34.577970 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:34.577903    2576 scope.go:122] "RemoveContainer" containerID="e3e42dd2ae422ef872dae5d4360f6d7dc989f9134e7b064ff96e490413e5e8d4"
Nov 03 17:16:35.585142 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:35.585064    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2" event={"ID":"32072064-dcf7-4c58-a5ef-47eeadb245e5","Type":"ContainerStarted","Data":"d66654416e5fa00a8cae86920a4ccb61dcbb1b9cee082b162af12a92a139547f"}
Nov 03 17:16:35.589074 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:35.589044    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2" event={"ID":"7ba6ecd5-1d02-4433-b245-1c957827467e","Type":"ContainerStarted","Data":"4b5687d235e652dc6f51b789d0d6158c4588688802f98aab42492033d1696fd6"}
Nov 03 17:16:35.592570 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:35.592543    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-vsdc5" event={"ID":"8ea83f1f-61e7-4236-a5e7-08c079de313b","Type":"ContainerStarted","Data":"5bb983af065c160c0033dfe3b49516a1192f229f81564526e15a0092f9dfbdbc"}
Nov 03 17:16:35.594989 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:35.594912    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/1.log"
Nov 03 17:16:35.595600 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:35.595582    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/0.log"
Nov 03 17:16:35.595702 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:35.595617    2576 generic.go:356] "Generic (PLEG): container finished" podID="0caf85ea-1bec-4670-a2e1-3cafd0e5a587" containerID="397e426a106fa9ee5cc7b4d7b54c4318d67e32e35d40b6133c43ee2df4a50d14" exitCode=255
Nov 03 17:16:35.595702 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:35.595652    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq" event={"ID":"0caf85ea-1bec-4670-a2e1-3cafd0e5a587","Type":"ContainerDied","Data":"397e426a106fa9ee5cc7b4d7b54c4318d67e32e35d40b6133c43ee2df4a50d14"}
Nov 03 17:16:35.595702 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:35.595691    2576 scope.go:122] "RemoveContainer" containerID="e3e42dd2ae422ef872dae5d4360f6d7dc989f9134e7b064ff96e490413e5e8d4"
Nov 03 17:16:35.595994 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:35.595973    2576 scope.go:122] "RemoveContainer" containerID="397e426a106fa9ee5cc7b4d7b54c4318d67e32e35d40b6133c43ee2df4a50d14"
Nov 03 17:16:35.596154 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:35.596137    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-6fwkq_openshift-console-operator(0caf85ea-1bec-4670-a2e1-3cafd0e5a587)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq" podUID="0caf85ea-1bec-4670-a2e1-3cafd0e5a587"
Nov 03 17:16:35.716410 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:35.716356    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2" podStartSLOduration=289.954422887 podStartE2EDuration="4m55.716339704s" totalImagesPullingTime="5.761916817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:11:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:35.710626485 +0000 UTC m=+39.765350678" watchObservedRunningTime="2026-11-03 17:16:35.716339704 +0000 UTC m=+39.771063869"
Nov 03 17:16:35.949332 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:35.949209    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-vsdc5" podStartSLOduration=288.854297084 podStartE2EDuration="4m54.949190446s" totalImagesPullingTime="6.094893362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:35.948123635 +0000 UTC m=+40.002847819" watchObservedRunningTime="2026-11-03 17:16:35.949190446 +0000 UTC m=+40.003914616"
Nov 03 17:16:36.067489 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.067422    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2" podStartSLOduration=292.406377294 podStartE2EDuration="4m58.067402506s" totalImagesPullingTime="5.661025212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:11:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:36.065915019 +0000 UTC m=+40.120639185" watchObservedRunningTime="2026-11-03 17:16:36.067402506 +0000 UTC m=+40.122126672"
Nov 03 17:16:36.352151 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.352107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:36.352357 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.352189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:36.352357 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.352268    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:36.352357 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.352311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:36.352513 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.352437    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 03 17:16:36.352513 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.352501    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs podName:12b0e63f-73f7-429a-879d-617267cc5f36 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:44.352482893 +0000 UTC m=+48.407207052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs") pod "router-default-678bd9c4d9-wrhq6" (UID: "12b0e63f-73f7-429a-879d-617267cc5f36") : secret "router-metrics-certs-default" not found
Nov 03 17:16:36.352860 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.352840    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:36.352860 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.352860    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c98dd6d65-rjtsq: secret "image-registry-tls" not found
Nov 03 17:16:36.353022 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.352904    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls podName:836fc8fa-ebbb-4836-b453-2b9be6db8452 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:44.352889489 +0000 UTC m=+48.407613634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls") pod "image-registry-7c98dd6d65-rjtsq" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452") : secret "image-registry-tls" not found
Nov 03 17:16:36.353022 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.352969    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle podName:12b0e63f-73f7-429a-879d-617267cc5f36 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:44.352959718 +0000 UTC m=+48.407683876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle") pod "router-default-678bd9c4d9-wrhq6" (UID: "12b0e63f-73f7-429a-879d-617267cc5f36") : configmap references non-existent config key: service-ca.crt
Nov 03 17:16:36.353147 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.353037    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:36.353147 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.353072    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls podName:e4451ce6-8729-4567-9e85-d5eba0db6139 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:44.353061738 +0000 UTC m=+48.407785896 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2wbdt" (UID: "e4451ce6-8729-4567-9e85-d5eba0db6139") : secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:36.453879 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.453354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:36.453879 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.453416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:36.453879 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.453497    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:36.453879 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.453619    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 03 17:16:36.453879 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.453673    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert podName:0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:44.453656404 +0000 UTC m=+48.508380548 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-jmrx4" (UID: "0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3") : secret "networking-console-plugin-cert" not found
Nov 03 17:16:36.453879 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.453718    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 03 17:16:36.453879 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.453740    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls podName:1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:44.453732637 +0000 UTC m=+48.508456794 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-mgljp" (UID: "1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66") : secret "samples-operator-tls" not found
Nov 03 17:16:36.453879 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.453787    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:36.453879 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.453798    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5599885c48-cn2ff: secret "image-registry-tls" not found
Nov 03 17:16:36.453879 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.453823    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls podName:10a6a241-8eef-4bf1-b609-dd71d2042646 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:44.453816583 +0000 UTC m=+48.508540740 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls") pod "image-registry-5599885c48-cn2ff" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646") : secret "image-registry-tls" not found
Nov 03 17:16:36.554521 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.554486    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:36.554689 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.554622    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 17:16:36.554760 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.554697    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls podName:2f2e4d96-73c8-4a18-b4f7-97387ed44645 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:44.554676224 +0000 UTC m=+48.609400368 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls") pod "dns-default-j4bd8" (UID: "2f2e4d96-73c8-4a18-b4f7-97387ed44645") : secret "dns-default-metrics-tls" not found
Nov 03 17:16:36.601748 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.601709    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gstrl" event={"ID":"2ef0f942-8c3c-43c9-bc45-a40b69188935","Type":"ContainerStarted","Data":"4b3872c651ad213cf27dcb72bc79bf2083a5f3723f8f1c14ecfc5f633e5a6d10"}
Nov 03 17:16:36.603765 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.603737    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/1.log"
Nov 03 17:16:36.604525 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.604496    2576 scope.go:122] "RemoveContainer" containerID="397e426a106fa9ee5cc7b4d7b54c4318d67e32e35d40b6133c43ee2df4a50d14"
Nov 03 17:16:36.604734 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.604697    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-6fwkq_openshift-console-operator(0caf85ea-1bec-4670-a2e1-3cafd0e5a587)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq" podUID="0caf85ea-1bec-4670-a2e1-3cafd0e5a587"
Nov 03 17:16:36.634839 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.634805    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9lj8v"]
Nov 03 17:16:36.648725 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.648691    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:36.703612 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.703250    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9lj8v"]
Nov 03 17:16:36.708532 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.708463    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jrssc\""
Nov 03 17:16:36.708643 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.708544    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 03 17:16:36.708643 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.708574    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 03 17:16:36.725176 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.725116    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gstrl" podStartSLOduration=2.16560427 podStartE2EDuration="8.725099923s" totalImagesPullingTime="6.559495653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:36.724572208 +0000 UTC m=+40.779296375" watchObservedRunningTime="2026-11-03 17:16:36.725099923 +0000 UTC m=+40.779824092"
Nov 03 17:16:36.756630 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.756597    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfgnv\" (UniqueName: \"kubernetes.io/projected/88031944-e289-40ee-b002-884805e6bec6-kube-api-access-pfgnv\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:36.756791 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.756640    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88031944-e289-40ee-b002-884805e6bec6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:36.756791 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.756733    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88031944-e289-40ee-b002-884805e6bec6-crio-socket\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:36.756791 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.756759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:36.756948 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.756794    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88031944-e289-40ee-b002-884805e6bec6-data-volume\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:36.858044 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.857785    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88031944-e289-40ee-b002-884805e6bec6-data-volume\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:36.858044 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.857938    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfgnv\" (UniqueName: \"kubernetes.io/projected/88031944-e289-40ee-b002-884805e6bec6-kube-api-access-pfgnv\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:36.858044 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.857968    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88031944-e289-40ee-b002-884805e6bec6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:36.858392 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.858069    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88031944-e289-40ee-b002-884805e6bec6-crio-socket\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:36.858392 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.858096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:36.858392 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.858257    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 17:16:36.858392 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.858318    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls podName:88031944-e289-40ee-b002-884805e6bec6 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:37.358300084 +0000 UTC m=+41.413024246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lj8v" (UID: "88031944-e289-40ee-b002-884805e6bec6") : secret "insights-runtime-extractor-tls" not found
Nov 03 17:16:36.858642 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.858623    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88031944-e289-40ee-b002-884805e6bec6-data-volume\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:36.858963 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.858947    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 03 17:16:36.859029 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:36.858997    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88031944-e289-40ee-b002-884805e6bec6-kube-rbac-proxy-cm podName:88031944-e289-40ee-b002-884805e6bec6 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:37.358982436 +0000 UTC m=+41.413706585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/88031944-e289-40ee-b002-884805e6bec6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9lj8v" (UID: "88031944-e289-40ee-b002-884805e6bec6") : configmap "kube-rbac-proxy" not found
Nov 03 17:16:36.859080 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.859056    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88031944-e289-40ee-b002-884805e6bec6-crio-socket\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:36.882734 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.882702    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-vjvw2-sht76"]
Nov 03 17:16:36.895605 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.895584    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:36.918909 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.918878    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-fb8hc"]
Nov 03 17:16:36.920254 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.920214    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfgnv\" (UniqueName: \"kubernetes.io/projected/88031944-e289-40ee-b002-884805e6bec6-kube-api-access-pfgnv\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:36.935351 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.935323    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-nbnrp"]
Nov 03 17:16:36.935509 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.935457    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb8hc"
Nov 03 17:16:36.949881 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.949858    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-57r42\""
Nov 03 17:16:36.951663 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.951540    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-vjvw2-sht76"]
Nov 03 17:16:36.951663 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.951639    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-nbnrp"
Nov 03 17:16:36.959849 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.959823    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6e6d73d7-6236-4642-9b4c-74940e54057a-archives-path\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:36.959933 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.959897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-service-ca-bundle\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:36.959933 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.959923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shlzs\" (UniqueName: \"kubernetes.io/projected/6e6d73d7-6236-4642-9b4c-74940e54057a-kube-api-access-shlzs\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:36.960029 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.960002    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-trusted-ca-bundle\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:36.980676 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.980648    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-fb8hc"]
Nov 03 17:16:36.990179 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.990152    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 03 17:16:36.990643 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.990358    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 03 17:16:36.991510 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:36.991429    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-nbnrp"]
Nov 03 17:16:37.050878 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.050856    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hvgjn\""
Nov 03 17:16:37.061466 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.061437    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6e6d73d7-6236-4642-9b4c-74940e54057a-archives-path\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:37.061586 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.061509    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-service-ca-bundle\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:37.061586 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.061536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shlzs\" (UniqueName: \"kubernetes.io/projected/6e6d73d7-6236-4642-9b4c-74940e54057a-kube-api-access-shlzs\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:37.061677 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.061614    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-trusted-ca-bundle\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:37.061724 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.061676    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq95k\" (UniqueName: \"kubernetes.io/projected/0414a02f-19b2-46cc-bf3e-884656ddee63-kube-api-access-rq95k\") pod \"migrator-66df5d496b-nbnrp\" (UID: \"0414a02f-19b2-46cc-bf3e-884656ddee63\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-nbnrp"
Nov 03 17:16:37.061787 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.061772    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnfnt\" (UniqueName: \"kubernetes.io/projected/98bb71f4-49c7-4216-b61e-f14b7b3a6368-kube-api-access-lnfnt\") pod \"migrator-66df5d496b-fb8hc\" (UID: \"98bb71f4-49c7-4216-b61e-f14b7b3a6368\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb8hc"
Nov 03 17:16:37.062571 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.061843    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6e6d73d7-6236-4642-9b4c-74940e54057a-archives-path\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:37.062571 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.062064    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-service-ca-bundle\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:37.062571 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.062521    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-trusted-ca-bundle\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:37.131829 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.131762    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shlzs\" (UniqueName: \"kubernetes.io/projected/6e6d73d7-6236-4642-9b4c-74940e54057a-kube-api-access-shlzs\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:37.162963 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.162929    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq95k\" (UniqueName: \"kubernetes.io/projected/0414a02f-19b2-46cc-bf3e-884656ddee63-kube-api-access-rq95k\") pod \"migrator-66df5d496b-nbnrp\" (UID: \"0414a02f-19b2-46cc-bf3e-884656ddee63\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-nbnrp"
Nov 03 17:16:37.163116 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.163002    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnfnt\" (UniqueName: \"kubernetes.io/projected/98bb71f4-49c7-4216-b61e-f14b7b3a6368-kube-api-access-lnfnt\") pod \"migrator-66df5d496b-fb8hc\" (UID: \"98bb71f4-49c7-4216-b61e-f14b7b3a6368\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb8hc"
Nov 03 17:16:37.219756 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.219678    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:37.224718 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.224687    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnfnt\" (UniqueName: \"kubernetes.io/projected/98bb71f4-49c7-4216-b61e-f14b7b3a6368-kube-api-access-lnfnt\") pod \"migrator-66df5d496b-fb8hc\" (UID: \"98bb71f4-49c7-4216-b61e-f14b7b3a6368\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb8hc"
Nov 03 17:16:37.225132 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.225111    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq95k\" (UniqueName: \"kubernetes.io/projected/0414a02f-19b2-46cc-bf3e-884656ddee63-kube-api-access-rq95k\") pod \"migrator-66df5d496b-nbnrp\" (UID: \"0414a02f-19b2-46cc-bf3e-884656ddee63\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-nbnrp"
Nov 03 17:16:37.268598 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.268569    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb8hc"
Nov 03 17:16:37.290505 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.290469    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-nbnrp"
Nov 03 17:16:37.367562 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.366016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:37.367562 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.366193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88031944-e289-40ee-b002-884805e6bec6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:37.367562 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:37.366386    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 17:16:37.367562 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:37.366452    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls podName:88031944-e289-40ee-b002-884805e6bec6 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:38.366432239 +0000 UTC m=+42.421156405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lj8v" (UID: "88031944-e289-40ee-b002-884805e6bec6") : secret "insights-runtime-extractor-tls" not found
Nov 03 17:16:37.367562 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:37.367454    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 03 17:16:37.367562 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:37.367518    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88031944-e289-40ee-b002-884805e6bec6-kube-rbac-proxy-cm podName:88031944-e289-40ee-b002-884805e6bec6 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:38.367496847 +0000 UTC m=+42.422221003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/88031944-e289-40ee-b002-884805e6bec6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9lj8v" (UID: "88031944-e289-40ee-b002-884805e6bec6") : configmap "kube-rbac-proxy" not found
Nov 03 17:16:37.609272 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.609218    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lb8nj" event={"ID":"69f0b08a-743a-441e-815c-015bcd833058","Type":"ContainerStarted","Data":"0d7f01d94afb45998ac84442c034f37dd74bd0b81ba66404ca387f02f03cea83"}
Nov 03 17:16:37.624511 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.624444    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-vjvw2-sht76"]
Nov 03 17:16:37.629361 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:16:37.629331    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6d73d7_6236_4642_9b4c_74940e54057a.slice/crio-167ca99aaa60a0330071a09ecf9dd7bcdb37b420afb38b9cae7140754b9cb71c WatchSource:0}: Error finding container 167ca99aaa60a0330071a09ecf9dd7bcdb37b420afb38b9cae7140754b9cb71c: Status 404 returned error can't find the container with id 167ca99aaa60a0330071a09ecf9dd7bcdb37b420afb38b9cae7140754b9cb71c
Nov 03 17:16:37.681555 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.681524    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-fb8hc"]
Nov 03 17:16:37.683993 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:16:37.683952    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98bb71f4_49c7_4216_b61e_f14b7b3a6368.slice/crio-38baf321624c1d4da7ec24d274eb2fd6811487320a1e70637d82c0322b203dcb WatchSource:0}: Error finding container 38baf321624c1d4da7ec24d274eb2fd6811487320a1e70637d82c0322b203dcb: Status 404 returned error can't find the container with id 38baf321624c1d4da7ec24d274eb2fd6811487320a1e70637d82c0322b203dcb
Nov 03 17:16:37.728639 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.728336    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lb8nj" podStartSLOduration=263.28007371 podStartE2EDuration="4m30.728317479s" totalImagesPullingTime="7.448243769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:12:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:37.72674345 +0000 UTC m=+41.781467617" watchObservedRunningTime="2026-11-03 17:16:37.728317479 +0000 UTC m=+41.783041647"
Nov 03 17:16:37.729985 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.729963    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-nbnrp"]
Nov 03 17:16:37.734704 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:16:37.734679    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0414a02f_19b2_46cc_bf3e_884656ddee63.slice/crio-850412c45e2f8253cc12004c9127dfff47ca55ab64fedf4ee8bd3e1e6c3d6209 WatchSource:0}: Error finding container 850412c45e2f8253cc12004c9127dfff47ca55ab64fedf4ee8bd3e1e6c3d6209: Status 404 returned error can't find the container with id 850412c45e2f8253cc12004c9127dfff47ca55ab64fedf4ee8bd3e1e6c3d6209
Nov 03 17:16:37.875204 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.875126    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-sch8k"]
Nov 03 17:16:37.892001 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.891975    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k"
Nov 03 17:16:37.932902 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.932871    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-sch8k"]
Nov 03 17:16:37.956755 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.956725    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Nov 03 17:16:37.956755 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.956725    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Nov 03 17:16:37.956961 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.956732    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Nov 03 17:16:37.956961 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.956755    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Nov 03 17:16:37.956961 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.956833    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-569sf\""
Nov 03 17:16:37.974585 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.974552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/80c620b9-0db9-47a5-a843-99d81db2ef95-signing-cabundle\") pod \"service-ca-5fffc97bdf-sch8k\" (UID: \"80c620b9-0db9-47a5-a843-99d81db2ef95\") " pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k"
Nov 03 17:16:37.974731 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.974607    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/80c620b9-0db9-47a5-a843-99d81db2ef95-signing-key\") pod \"service-ca-5fffc97bdf-sch8k\" (UID: \"80c620b9-0db9-47a5-a843-99d81db2ef95\") " pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k"
Nov 03 17:16:37.974792 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:37.974729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f2jx\" (UniqueName: \"kubernetes.io/projected/80c620b9-0db9-47a5-a843-99d81db2ef95-kube-api-access-2f2jx\") pod \"service-ca-5fffc97bdf-sch8k\" (UID: \"80c620b9-0db9-47a5-a843-99d81db2ef95\") " pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k"
Nov 03 17:16:38.076195 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.076155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/80c620b9-0db9-47a5-a843-99d81db2ef95-signing-cabundle\") pod \"service-ca-5fffc97bdf-sch8k\" (UID: \"80c620b9-0db9-47a5-a843-99d81db2ef95\") " pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k"
Nov 03 17:16:38.076195 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.076208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/80c620b9-0db9-47a5-a843-99d81db2ef95-signing-key\") pod \"service-ca-5fffc97bdf-sch8k\" (UID: \"80c620b9-0db9-47a5-a843-99d81db2ef95\") " pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k"
Nov 03 17:16:38.076478 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.076289    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f2jx\" (UniqueName: \"kubernetes.io/projected/80c620b9-0db9-47a5-a843-99d81db2ef95-kube-api-access-2f2jx\") pod \"service-ca-5fffc97bdf-sch8k\" (UID: \"80c620b9-0db9-47a5-a843-99d81db2ef95\") " pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k"
Nov 03 17:16:38.076929 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.076908    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/80c620b9-0db9-47a5-a843-99d81db2ef95-signing-cabundle\") pod \"service-ca-5fffc97bdf-sch8k\" (UID: \"80c620b9-0db9-47a5-a843-99d81db2ef95\") " pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k"
Nov 03 17:16:38.079034 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.079010    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/80c620b9-0db9-47a5-a843-99d81db2ef95-signing-key\") pod \"service-ca-5fffc97bdf-sch8k\" (UID: \"80c620b9-0db9-47a5-a843-99d81db2ef95\") " pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k"
Nov 03 17:16:38.146857 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.146786    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f2jx\" (UniqueName: \"kubernetes.io/projected/80c620b9-0db9-47a5-a843-99d81db2ef95-kube-api-access-2f2jx\") pod \"service-ca-5fffc97bdf-sch8k\" (UID: \"80c620b9-0db9-47a5-a843-99d81db2ef95\") " pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k"
Nov 03 17:16:38.217473 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.217434    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k"
Nov 03 17:16:38.378284 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.378243    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:38.378467 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:38.378339    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 17:16:38.378467 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.378395    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88031944-e289-40ee-b002-884805e6bec6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:38.378467 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:38.378407    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls podName:88031944-e289-40ee-b002-884805e6bec6 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:40.378391538 +0000 UTC m=+44.433115695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lj8v" (UID: "88031944-e289-40ee-b002-884805e6bec6") : secret "insights-runtime-extractor-tls" not found
Nov 03 17:16:38.378467 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:38.378456    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 03 17:16:38.378665 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:38.378506    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88031944-e289-40ee-b002-884805e6bec6-kube-rbac-proxy-cm podName:88031944-e289-40ee-b002-884805e6bec6 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:40.378490664 +0000 UTC m=+44.433214808 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/88031944-e289-40ee-b002-884805e6bec6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9lj8v" (UID: "88031944-e289-40ee-b002-884805e6bec6") : configmap "kube-rbac-proxy" not found
Nov 03 17:16:38.614916 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.614868    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vjvw2-sht76" event={"ID":"6e6d73d7-6236-4642-9b4c-74940e54057a","Type":"ContainerStarted","Data":"04f771462f35fbb1cdb3c927907297731654d1f8dee4fae253a714ce4345453c"}
Nov 03 17:16:38.615355 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.614942    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vjvw2-sht76" event={"ID":"6e6d73d7-6236-4642-9b4c-74940e54057a","Type":"ContainerStarted","Data":"167ca99aaa60a0330071a09ecf9dd7bcdb37b420afb38b9cae7140754b9cb71c"}
Nov 03 17:16:38.616142 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.616112    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb8hc" event={"ID":"98bb71f4-49c7-4216-b61e-f14b7b3a6368","Type":"ContainerStarted","Data":"38baf321624c1d4da7ec24d274eb2fd6811487320a1e70637d82c0322b203dcb"}
Nov 03 17:16:38.617751 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.617721    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s7n7v" event={"ID":"34d75159-9865-405a-88fe-5cf738813dde","Type":"ContainerStarted","Data":"00ddbf83fd9d574589755dbc92d4bfd98d671c2e4a0d9638f8bf96134cf4e94f"}
Nov 03 17:16:38.617856 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.617798    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:38.619035 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.619003    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-nbnrp" event={"ID":"0414a02f-19b2-46cc-bf3e-884656ddee63","Type":"ContainerStarted","Data":"850412c45e2f8253cc12004c9127dfff47ca55ab64fedf4ee8bd3e1e6c3d6209"}
Nov 03 17:16:38.638287 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.638261    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-sch8k"]
Nov 03 17:16:38.641324 ip-10-0-137-219 kubenswrapper[2576]: W1103 17:16:38.641286    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c620b9_0db9_47a5_a843_99d81db2ef95.slice/crio-5cd9cb85581dcd0a9b6397a8cd65e81ebd50e6f4ea49651dc7868e1e3283e038 WatchSource:0}: Error finding container 5cd9cb85581dcd0a9b6397a8cd65e81ebd50e6f4ea49651dc7868e1e3283e038: Status 404 returned error can't find the container with id 5cd9cb85581dcd0a9b6397a8cd65e81ebd50e6f4ea49651dc7868e1e3283e038
Nov 03 17:16:38.741497 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.741430    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-vjvw2-sht76" podStartSLOduration=2.741410228 podStartE2EDuration="2.741410228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:16:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:38.739676997 +0000 UTC m=+42.794401164" watchObservedRunningTime="2026-11-03 17:16:38.741410228 +0000 UTC m=+42.796134397"
Nov 03 17:16:38.794325 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.794293    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:38.794800 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.794780    2576 scope.go:122] "RemoveContainer" containerID="397e426a106fa9ee5cc7b4d7b54c4318d67e32e35d40b6133c43ee2df4a50d14"
Nov 03 17:16:38.795022 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:38.794988    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-6fwkq_openshift-console-operator(0caf85ea-1bec-4670-a2e1-3cafd0e5a587)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq" podUID="0caf85ea-1bec-4670-a2e1-3cafd0e5a587"
Nov 03 17:16:38.795148 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.795085    2576 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:38.858540 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:38.858491    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s7n7v" podStartSLOduration=34.946688691 podStartE2EDuration="41.858474025s" totalImagesPullingTime="6.911785334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:16:38.858419777 +0000 UTC m=+42.913143944" watchObservedRunningTime="2026-11-03 17:16:38.858474025 +0000 UTC m=+42.913198190"
Nov 03 17:16:39.626433 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:39.626348    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k" event={"ID":"80c620b9-0db9-47a5-a843-99d81db2ef95","Type":"ContainerStarted","Data":"3831e2d49eaa70a9720af52fcc8adbe89237b7e24f485b73724c682b679acbc8"}
Nov 03 17:16:39.626849 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:39.626488    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k" event={"ID":"80c620b9-0db9-47a5-a843-99d81db2ef95","Type":"ContainerStarted","Data":"5cd9cb85581dcd0a9b6397a8cd65e81ebd50e6f4ea49651dc7868e1e3283e038"}
Nov 03 17:16:39.628142 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:39.628114    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cfrm8" event={"ID":"10d51151-30e6-4c36-a13b-5af9c5ba56e8","Type":"ContainerStarted","Data":"8070f5b36437fc5cfa07af3994de02408cf28ac95f909c2f5533c3896d446e06"}
Nov 03 17:16:39.628664 ip-10-0-137-219 kubenswrapper[2576]: I1103 17:16:39.628645    2576 scope.go:122] "RemoveContainer" containerID="397e426a106fa9ee5cc7b4d7b54c4318d67e32e35d40b6133c43ee2df4a50d14"
Nov 03 17:16:39.628825 ip-10-0-137-219 kubenswrapper[2576]: E1103 17:16:39.628806    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-6fwkq_openshift-console-operator(0caf85ea-1bec-4670-a2e1-3cafd0e5a587)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq" podUID="0caf85ea-1bec-4670-a2e1-3cafd0e5a587"
Nov 03 17:16:39.717170 ip-10-0-137-219 systemd[1]: Stopping Kubernetes Kubelet...
Nov 03 17:16:39.739685 ip-10-0-137-219 systemd[1]: kubelet.service: Deactivated successfully.
Nov 03 17:16:39.739857 ip-10-0-137-219 systemd[1]: Stopped Kubernetes Kubelet.
Nov 03 17:16:39.739907 ip-10-0-137-219 systemd[1]: kubelet.service: Consumed 3.230s CPU time.
Nov 03 17:16:39.754732 ip-10-0-137-219 systemd[1]: Starting Kubernetes Kubelet...
Nov 03 17:16:39.862421 ip-10-0-137-219 kubenswrapper[5021]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 17:16:39.862421 ip-10-0-137-219 kubenswrapper[5021]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 03 17:16:39.862421 ip-10-0-137-219 kubenswrapper[5021]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 17:16:39.862421 ip-10-0-137-219 kubenswrapper[5021]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 17:16:39.864537 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864479    5021 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 17:16:39.864537 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864537    5021 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 17:16:39.864537 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864541    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864544    5021 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864548    5021 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864552    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864554    5021 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864557    5021 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864560    5021 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864562    5021 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864565    5021 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864568    5021 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864570    5021 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864573    5021 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864576    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864579    5021 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864581    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864584    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864587    5021 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864590    5021 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864592    5021 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864595    5021 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 17:16:39.864657 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864597    5021 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864600    5021 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864603    5021 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864606    5021 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864613    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864616    5021 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864619    5021 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864622    5021 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864624    5021 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864627    5021 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864630    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864634    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864638    5021 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864640    5021 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864643    5021 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864646    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864649    5021 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864651    5021 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864654    5021 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864657    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 17:16:39.865203 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864660    5021 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864662    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864666    5021 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864669    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864672    5021 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864674    5021 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864677    5021 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864680    5021 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864683    5021 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864686    5021 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864688    5021 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864691    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864693    5021 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864696    5021 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864701    5021 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864705    5021 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864709    5021 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864712    5021 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864716    5021 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 17:16:39.865757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864719    5021 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864722    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864726    5021 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864730    5021 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864733    5021 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864736    5021 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864739    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864742    5021 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864744    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864747    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864749    5021 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864752    5021 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864755    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864757    5021 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864760    5021 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864762    5021 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864765    5021 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864768    5021 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864770    5021 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 17:16:39.866257 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864772    5021 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864775    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864778    5021 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864780    5021 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864783    5021 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864785    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864788    5021 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864792    5021 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864795    5021 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864797    5021 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864800    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864802    5021 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864806    5021 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864808    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864811    5021 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864813    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864816    5021 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864819    5021 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864821    5021 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864824    5021 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 17:16:39.866716 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864827    5021 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864829    5021 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864832    5021 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864834    5021 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864837    5021 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.864839    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865671    5021 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865679    5021 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865682    5021 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865686    5021 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865690    5021 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865693    5021 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865696    5021 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865699    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865702    5021 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865705    5021 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865708    5021 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865710    5021 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865713    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865716    5021 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 17:16:39.867220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865718    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865721    5021 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865724    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865726    5021 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865730    5021 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865733    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865736    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865739    5021 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865742    5021 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865745    5021 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865747    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865750    5021 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865752    5021 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865755    5021 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865758    5021 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865762    5021 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865766    5021 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865769    5021 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865772    5021 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 17:16:39.867748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865776    5021 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865779    5021 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865781    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865784    5021 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865787    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865789    5021 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865792    5021 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865795    5021 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865797    5021 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865800    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865802    5021 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865806    5021 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865808    5021 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865812    5021 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865814    5021 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865817    5021 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865819    5021 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865822    5021 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865825    5021 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865828    5021 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 17:16:39.868252 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865831    5021 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865834    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865837    5021 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865840    5021 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865842    5021 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865845    5021 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865847    5021 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865852    5021 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865855    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865858    5021 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865861    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865864    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865866    5021 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865869    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865872    5021 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865874    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865877    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865880    5021 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865882    5021 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 17:16:39.868748 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865885    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865930    5021 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865935    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865939    5021 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865944    5021 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865947    5021 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865949    5021 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865952    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865955    5021 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865958    5021 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865961    5021 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865964    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865967    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865970    5021 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865973    5021 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865976    5021 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865979    5021 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865981    5021 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865984    5021 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 17:16:39.869207 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865986    5021 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865989    5021 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865991    5021 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865994    5021 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.865998    5021 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866000    5021 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866003    5021 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866006    5021 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866009    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866011    5021 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866014    5021 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866017    5021 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866020    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866022    5021 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866024    5021 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866583    5021 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866592    5021 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866598    5021 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866604    5021 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866607    5021 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 17:16:39.869721 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866610    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866613    5021 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866616    5021 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866619    5021 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866621    5021 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866625    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866628    5021 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866632    5021 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866634    5021 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866637    5021 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866639    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866642    5021 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866645    5021 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866648    5021 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866650    5021 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866653    5021 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866655    5021 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866659    5021 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866661    5021 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 17:16:39.870206 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866664    5021 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866667    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866669    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866672    5021 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866676    5021 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866678    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866681    5021 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866683    5021 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866686    5021 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866689    5021 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866691    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866694    5021 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866697    5021 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866700    5021 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866703    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866705    5021 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866708    5021 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866710    5021 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866713    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866716    5021 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 17:16:39.870694 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866719    5021 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866722    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866725    5021 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866728    5021 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866730    5021 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866736    5021 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866739    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866742    5021 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866745    5021 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866749    5021 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866753    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866756    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866760    5021 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866764    5021 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866767    5021 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866770    5021 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866772    5021 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866775    5021 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866778    5021 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 17:16:39.871277 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866780    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866783    5021 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866786    5021 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866788    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866791    5021 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866793    5021 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866796    5021 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866798    5021 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866801    5021 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866805    5021 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866809    5021 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866812    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866815    5021 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866818    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866820    5021 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866823    5021 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866826    5021 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866828    5021 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866832    5021 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 17:16:39.871795 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866835    5021 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866838    5021 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866842    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866844    5021 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866847    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866849    5021 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866852    5021 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866855    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866857    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866860    5021 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866862    5021 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866865    5021 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866867    5021 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866870    5021 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866873    5021 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866875    5021 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866878    5021 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866880    5021 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866883    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 17:16:39.872275 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866886    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866888    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866890    5021 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866893    5021 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.866895    5021 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.866993    5021 flags.go:64] FLAG: --address="0.0.0.0"
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867000    5021 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867007    5021 flags.go:64] FLAG: --anonymous-auth="true"
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867012    5021 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867017    5021 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867021    5021 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867025    5021 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867030    5021 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867034    5021 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867037    5021 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867041    5021 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867044    5021 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867047    5021 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867050    5021 flags.go:64] FLAG: --cgroup-root=""
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867053    5021 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867057    5021 flags.go:64] FLAG: --client-ca-file=""
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867060    5021 flags.go:64] FLAG: --cloud-provider="external"
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867063    5021 flags.go:64] FLAG: --cluster-dns="[]"
Nov 03 17:16:39.873009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867067    5021 flags.go:64] FLAG: --cluster-domain=""
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867070    5021 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867073    5021 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867076    5021 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867080    5021 flags.go:64] FLAG: --container-log-max-files="5"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867084    5021 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867087    5021 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867090    5021 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867093    5021 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867096    5021 flags.go:64] FLAG: --contention-profiling="false"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867099    5021 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867103    5021 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867106    5021 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867109    5021 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867114    5021 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867117    5021 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867120    5021 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867123    5021 flags.go:64] FLAG: --enable-load-reader="false"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867126    5021 flags.go:64] FLAG: --enable-server="true"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867130    5021 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867134    5021 flags.go:64] FLAG: --event-burst="100"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867139    5021 flags.go:64] FLAG: --event-qps="50"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867143    5021 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867146    5021 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 03 17:16:39.873843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867150    5021 flags.go:64] FLAG: --eviction-hard=""
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867154    5021 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867157    5021 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867160    5021 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867164    5021 flags.go:64] FLAG: --eviction-soft=""
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867167    5021 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867170    5021 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867173    5021 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867176    5021 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867180    5021 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867183    5021 flags.go:64] FLAG: --fail-swap-on="true"
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867186    5021 flags.go:64] FLAG: --feature-gates=""
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867193    5021 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867197    5021 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867200    5021 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867203    5021 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867207    5021 flags.go:64] FLAG: --healthz-port="10248"
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867210    5021 flags.go:64] FLAG: --help="false"
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867213    5021 flags.go:64] FLAG: --hostname-override="ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867216    5021 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867220    5021 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867234    5021 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867238    5021 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 03 17:16:39.874495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867242    5021 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867245    5021 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867248    5021 flags.go:64] FLAG: --image-service-endpoint=""
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867252    5021 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867255    5021 flags.go:64] FLAG: --kube-api-burst="100"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867259    5021 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867264    5021 flags.go:64] FLAG: --kube-api-qps="50"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867267    5021 flags.go:64] FLAG: --kube-reserved=""
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867270    5021 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867274    5021 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867277    5021 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867280    5021 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867283    5021 flags.go:64] FLAG: --lock-file=""
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867286    5021 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867289    5021 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867292    5021 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867298    5021 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867301    5021 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867304    5021 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867307    5021 flags.go:64] FLAG: --logging-format="text"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867310    5021 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867314    5021 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867317    5021 flags.go:64] FLAG: --manifest-url=""
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867320    5021 flags.go:64] FLAG: --manifest-url-header=""
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867324    5021 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 03 17:16:39.875097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867327    5021 flags.go:64] FLAG: --max-open-files="1000000"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867331    5021 flags.go:64] FLAG: --max-pods="110"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867334    5021 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867337    5021 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867340    5021 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867343    5021 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867347    5021 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867350    5021 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867353    5021 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867361    5021 flags.go:64] FLAG: --node-status-max-images="50"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867364    5021 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867367    5021 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867371    5021 flags.go:64] FLAG: --pod-cidr=""
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867376    5021 flags.go:64] FLAG: --pod-manifest-path=""
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867380    5021 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867383    5021 flags.go:64] FLAG: --pods-per-core="0"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867386    5021 flags.go:64] FLAG: --port="10250"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867389    5021 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867392    5021 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-05a18e1f5a6b228eb"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867395    5021 flags.go:64] FLAG: --qos-reserved=""
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867399    5021 flags.go:64] FLAG: --read-only-port="10255"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867402    5021 flags.go:64] FLAG: --register-node="true"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867405    5021 flags.go:64] FLAG: --register-with-taints=""
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867409    5021 flags.go:64] FLAG: --registry-burst="10"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867412    5021 flags.go:64] FLAG: --registry-qps="5"
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867415    5021 flags.go:64] FLAG: --reserved-cpus=""
Nov 03 17:16:39.875737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867418    5021 flags.go:64] FLAG: --reserved-memory=""
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867423    5021 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867426    5021 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867429    5021 flags.go:64] FLAG: --rotate-certificates="false"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867432    5021 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867435    5021 flags.go:64] FLAG: --runonce="false"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867439    5021 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867442    5021 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867445    5021 flags.go:64] FLAG: --seccomp-default="false"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867448    5021 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867452    5021 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867455    5021 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867459    5021 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867463    5021 flags.go:64] FLAG: --storage-driver-password="root"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867466    5021 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867469    5021 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867472    5021 flags.go:64] FLAG: --storage-driver-user="root"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867475    5021 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867478    5021 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867482    5021 flags.go:64] FLAG: --system-cgroups=""
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867486    5021 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867492    5021 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867495    5021 flags.go:64] FLAG: --tls-cert-file=""
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867498    5021 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867502    5021 flags.go:64] FLAG: --tls-min-version=""
Nov 03 17:16:39.876386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867505    5021 flags.go:64] FLAG: --tls-private-key-file=""
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867508    5021 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867511    5021 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867514    5021 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867517    5021 flags.go:64] FLAG: --v="2"
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867522    5021 flags.go:64] FLAG: --version="false"
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867526    5021 flags.go:64] FLAG: --vmodule=""
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867530    5021 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867533    5021 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867668    5021 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867672    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867675    5021 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867678    5021 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867681    5021 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867684    5021 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867686    5021 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867689    5021 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867691    5021 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867694    5021 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867698    5021 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867701    5021 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 17:16:39.877002 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867703    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867706    5021 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867708    5021 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867711    5021 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867714    5021 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867718    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867720    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867724    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867727    5021 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867729    5021 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867732    5021 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867735    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867737    5021 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867740    5021 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867743    5021 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867746    5021 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867748    5021 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867751    5021 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867754    5021 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867757    5021 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 17:16:39.877548 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867760    5021 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867763    5021 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867766    5021 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867768    5021 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867771    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867773    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867776    5021 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867779    5021 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867782    5021 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867785    5021 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867789    5021 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867792    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867795    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867797    5021 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867800    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867802    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867805    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867809    5021 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867811    5021 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 17:16:39.878023 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867814    5021 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867817    5021 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867820    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867822    5021 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867824    5021 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867827    5021 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867830    5021 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867832    5021 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867835    5021 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867837    5021 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867840    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867842    5021 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867845    5021 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867847    5021 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867850    5021 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867852    5021 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867855    5021 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867858    5021 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867861    5021 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867863    5021 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 17:16:39.878499 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867866    5021 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867869    5021 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867871    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867876    5021 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867878    5021 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867881    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867883    5021 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867886    5021 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867890    5021 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867894    5021 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867897    5021 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867900    5021 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867903    5021 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867905    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867908    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867911    5021 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867914    5021 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867916    5021 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867920    5021 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 17:16:39.878989 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867924    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 17:16:39.879512 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867927    5021 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 17:16:39.879512 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867929    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 17:16:39.879512 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867932    5021 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 17:16:39.879512 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867935    5021 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 17:16:39.879512 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867938    5021 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 17:16:39.879512 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867941    5021 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 17:16:39.879512 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867943    5021 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 17:16:39.879512 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867946    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 17:16:39.879512 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867949    5021 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 17:16:39.879512 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867951    5021 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 17:16:39.879512 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867954    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 17:16:39.879512 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867956    5021 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 17:16:39.879512 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867959    5021 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 17:16:39.879512 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867962    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 17:16:39.879512 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.867964    5021 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 17:16:39.879512 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.867992    5021 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868029    5021 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868034    5021 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868037    5021 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868040    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868043    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868046    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868049    5021 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868052    5021 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868055    5021 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868057    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868060    5021 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868063    5021 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868066    5021 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868069    5021 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868071    5021 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868074    5021 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868076    5021 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868079    5021 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868082    5021 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 17:16:39.879958 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868085    5021 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868088    5021 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868090    5021 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868093    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868095    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868098    5021 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868101    5021 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868104    5021 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868107    5021 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868110    5021 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868112    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868115    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868117    5021 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868121    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868124    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868126    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868129    5021 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868132    5021 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868134    5021 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 17:16:39.880489 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868137    5021 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868139    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868142    5021 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868144    5021 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868147    5021 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868149    5021 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868152    5021 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868155    5021 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868158    5021 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868160    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868163    5021 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868165    5021 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868168    5021 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868170    5021 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868173    5021 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868176    5021 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868178    5021 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868181    5021 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868184    5021 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868186    5021 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 17:16:39.880986 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868189    5021 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868192    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868194    5021 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868198    5021 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868200    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868203    5021 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868208    5021 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868212    5021 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868215    5021 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868218    5021 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868221    5021 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868235    5021 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868238    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868240    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868243    5021 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868245    5021 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868248    5021 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868253    5021 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868257    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 17:16:39.881602 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868261    5021 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868265    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868268    5021 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868270    5021 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868273    5021 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868276    5021 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868278    5021 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868281    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868283    5021 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868286    5021 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868289    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868291    5021 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868294    5021 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868296    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868299    5021 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868302    5021 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868304    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868307    5021 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868310    5021 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 17:16:39.882164 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868315    5021 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868317    5021 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868320    5021 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868322    5021 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868325    5021 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868328    5021 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868330    5021 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868333    5021 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868336    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.868338    5021 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.873565    5021 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.873721    5021 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.873928    5021 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.873936    5021 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874023    5021 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874029    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874032    5021 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874035    5021 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874038    5021 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 17:16:39.882672 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874041    5021 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874044    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874047    5021 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874050    5021 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874052    5021 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874055    5021 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874058    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874061    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874064    5021 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874066    5021 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874069    5021 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874072    5021 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874075    5021 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874078    5021 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874081    5021 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874084    5021 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874086    5021 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874089    5021 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874142    5021 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874146    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 17:16:39.883140 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874149    5021 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874152    5021 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874156    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874159    5021 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874163    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874166    5021 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874168    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874171    5021 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874174    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874177    5021 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874180    5021 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874182    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874187    5021 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874191    5021 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874194    5021 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874198    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874201    5021 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874204    5021 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874206    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 17:16:39.883852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874209    5021 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874212    5021 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874215    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874218    5021 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874221    5021 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874237    5021 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874241    5021 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874245    5021 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874249    5021 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874253    5021 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874256    5021 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874259    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874261    5021 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874264    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874267    5021 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874270    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874272    5021 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874275    5021 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874278    5021 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874281    5021 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 17:16:39.884350 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874284    5021 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874286    5021 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874289    5021 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874292    5021 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874294    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874297    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874300    5021 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874302    5021 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874305    5021 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874307    5021 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874310    5021 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874313    5021 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874316    5021 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874318    5021 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874321    5021 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874326    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874329    5021 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874332    5021 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874335    5021 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 17:16:39.884845 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874339    5021 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874343    5021 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874346    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874348    5021 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874351    5021 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874354    5021 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874357    5021 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874360    5021 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874362    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874365    5021 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874368    5021 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874370    5021 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874373    5021 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874376    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874378    5021 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874381    5021 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874384    5021 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874386    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874389    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874391    5021 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 17:16:39.885463 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874394    5021 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 17:16:39.885939 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874396    5021 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 17:16:39.885939 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874399    5021 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 17:16:39.885939 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.874431    5021 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 17:16:39.885939 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874582    5021 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 17:16:39.885939 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874588    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 17:16:39.885939 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874591    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 17:16:39.885939 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874594    5021 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 17:16:39.885939 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874597    5021 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 17:16:39.885939 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874600    5021 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 17:16:39.885939 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874604    5021 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 17:16:39.885939 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874606    5021 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 17:16:39.885939 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874609    5021 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 17:16:39.885939 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874612    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 17:16:39.885939 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874615    5021 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 17:16:39.885939 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874617    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 17:16:39.885939 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874620    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874623    5021 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874625    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874628    5021 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874630    5021 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874633    5021 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874636    5021 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874638    5021 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874641    5021 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874643    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874646    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874649    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874651    5021 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874654    5021 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874656    5021 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874659    5021 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874662    5021 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874664    5021 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874667    5021 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874670    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 17:16:39.886331 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874672    5021 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874675    5021 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874678    5021 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874680    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874683    5021 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874686    5021 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874689    5021 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874692    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874695    5021 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874697    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874700    5021 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874703    5021 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874705    5021 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874708    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874711    5021 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874714    5021 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874716    5021 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874719    5021 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874723    5021 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 17:16:39.886883 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874727    5021 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874731    5021 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874734    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874737    5021 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874740    5021 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874742    5021 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874745    5021 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874748    5021 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874750    5021 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874753    5021 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874756    5021 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874758    5021 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874761    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874764    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874767    5021 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874769    5021 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874772    5021 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874775    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874777    5021 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874780    5021 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 17:16:39.887375 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874783    5021 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874785    5021 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874788    5021 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874791    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874794    5021 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874796    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874799    5021 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874801    5021 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874804    5021 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874806    5021 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874809    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874811    5021 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874815    5021 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874819    5021 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874822    5021 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874825    5021 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874828    5021 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874830    5021 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874833    5021 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 17:16:39.887862 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874836    5021 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 17:16:39.888342 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874838    5021 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 17:16:39.888342 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874841    5021 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 17:16:39.888342 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874844    5021 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 17:16:39.888342 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874846    5021 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 17:16:39.888342 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874850    5021 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 17:16:39.888342 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874853    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 17:16:39.888342 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874855    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 17:16:39.888342 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874858    5021 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 17:16:39.888342 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874860    5021 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 17:16:39.888342 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874863    5021 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 17:16:39.888342 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874866    5021 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 17:16:39.888342 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874868    5021 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 17:16:39.888342 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874871    5021 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 17:16:39.888342 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874875    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 17:16:39.888342 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874877    5021 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 17:16:39.888342 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.874903    5021 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874936    5021 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874940    5021 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874942    5021 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874946    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874949    5021 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874952    5021 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874955    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874958    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874960    5021 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874963    5021 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874966    5021 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874969    5021 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874972    5021 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874989    5021 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874994    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.874997    5021 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875000    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875003    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875006    5021 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 17:16:39.888825 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875008    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875011    5021 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875014    5021 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875016    5021 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875019    5021 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875021    5021 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875024    5021 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875026    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875029    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875031    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875034    5021 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875037    5021 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875040    5021 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875042    5021 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875048    5021 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875051    5021 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875053    5021 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875056    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875059    5021 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875062    5021 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 17:16:39.889511 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875064    5021 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875067    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875070    5021 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875072    5021 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875075    5021 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875078    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875080    5021 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875083    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875085    5021 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875088    5021 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875091    5021 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875093    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875096    5021 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875099    5021 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875101    5021 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875104    5021 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875109    5021 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875113    5021 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875116    5021 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 17:16:39.890220 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875119    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875121    5021 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875124    5021 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875127    5021 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875129    5021 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875133    5021 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875136    5021 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875142    5021 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875144    5021 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875147    5021 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875150    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875153    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875155    5021 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875158    5021 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875161    5021 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875164    5021 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875166    5021 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875169    5021 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875172    5021 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875174    5021 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 17:16:39.891044 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875177    5021 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875180    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875182    5021 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875185    5021 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875188    5021 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875190    5021 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875193    5021 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875195    5021 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875198    5021 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875200    5021 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875204    5021 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875209    5021 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875213    5021 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875216    5021 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875219    5021 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875237    5021 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875241    5021 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875245    5021 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875249    5021 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 17:16:39.891914 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875254    5021 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 17:16:39.892411 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875257    5021 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 17:16:39.892411 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875260    5021 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 17:16:39.892411 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875262    5021 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 17:16:39.892411 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875266    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 17:16:39.892411 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875269    5021 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 17:16:39.892411 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875271    5021 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 17:16:39.892411 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875274    5021 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 17:16:39.892411 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:39.875277    5021 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 17:16:39.892411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.875339    5021 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 03 17:16:39.892411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.876380    5021 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 03 17:16:39.892411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.876446    5021 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 03 17:16:39.892411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.876621    5021 server.go:1014] "Starting client certificate rotation"
Nov 03 17:16:39.892411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.876754    5021 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 03 17:16:39.892411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.876809    5021 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 17:10:56 +0000 UTC" deadline="2028-07-23 00:19:21.228387378 +0000 UTC"
Nov 03 17:16:39.892411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.876840    5021 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15055h2m41.35155091s"
Nov 03 17:16:39.892411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.877085    5021 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 03 17:16:39.892878 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.878261    5021 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 03 17:16:39.892878 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.879564    5021 log.go:25] "Validated CRI v1 runtime API"
Nov 03 17:16:39.892878 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.881256    5021 log.go:25] "Validated CRI v1 image API"
Nov 03 17:16:39.892878 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.882059    5021 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 03 17:16:39.892878 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.884127    5021 fs.go:135] Filesystem UUIDs: map[1a17df9a-0424-4e24-a761-391cdb66cacf:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e310cb75-040b-42fc-8bfe-edca5d1ef92d:/dev/nvme0n1p4]
Nov 03 17:16:39.893092 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.884151    5021 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/01fa94ee14816352d717f70b921db29a366f22bc7a92e77a4b829b1d6dbe48a3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/01fa94ee14816352d717f70b921db29a366f22bc7a92e77a4b829b1d6dbe48a3/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/153016ed6485aedbabcaf14789c3495ba2c493ba4b00ea2811a98926383388a4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/153016ed6485aedbabcaf14789c3495ba2c493ba4b00ea2811a98926383388a4/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/167ca99aaa60a0330071a09ecf9dd7bcdb37b420afb38b9cae7140754b9cb71c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/167ca99aaa60a0330071a09ecf9dd7bcdb37b420afb38b9cae7140754b9cb71c/userdata/shm major:0 minor:336 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/182ee7d4156bcaaadb6e5e265c14fc1918dbc7868aa56cbb7dc5ec0254b5b48b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/182ee7d4156bcaaadb6e5e265c14fc1918dbc7868aa56cbb7dc5ec0254b5b48b/userdata/shm major:0 minor:222 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2fb9254e65b9145bb5a84caa9b1bb152abbe58598b653795e58cae8fb7d2685d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2fb9254e65b9145bb5a84caa9b1bb152abbe58598b653795e58cae8fb7d2685d/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/38baf321624c1d4da7ec24d274eb2fd6811487320a1e70637d82c0322b203dcb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/38baf321624c1d4da7ec24d274eb2fd6811487320a1e70637d82c0322b203dcb/userdata/shm major:0 minor:338 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/39089e125d6e2237461529f1ba3bbd05b228a3e102e55a4ac8adf75c8472de14/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/39089e125d6e2237461529f1ba3bbd05b228a3e102e55a4ac8adf75c8472de14/userdata/shm major:0 minor:224 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3a671b0882cfc6d4e2490726bb229dc55d2acd6ef7a4395c73d20862b450f2a9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3a671b0882cfc6d4e2490726bb229dc55d2acd6ef7a4395c73d20862b450f2a9/userdata/shm major:0 minor:290 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3a9d8a3ed6d1b22fb2e5162de99c708236e814e47812cc5d2ab98ca78ba11293/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3a9d8a3ed6d1b22fb2e5162de99c708236e814e47812cc5d2ab98ca78ba11293/userdata/shm major:0 minor:288 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/472ba7557e4d165c27da4a0eda01ae8b90cb3d6f686af8c9421a9e5373717633/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/472ba7557e4d165c27da4a0eda01ae8b90cb3d6f686af8c9421a9e5373717633/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/48845cd48640879501870b3082845c2d1a1eea2d9a42ee3ec23a1f744c30baed/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/48845cd48640879501870b3082845c2d1a1eea2d9a42ee3ec23a1f744c30baed/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5cd9cb85581dcd0a9b6397a8cd65e81ebd50e6f4ea49651dc7868e1e3283e038/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5cd9cb85581dcd0a9b6397a8cd65e81ebd50e6f4ea49651dc7868e1e3283e038/userdata/shm major:0 minor:362 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/61a3bedb1f58b0329d222bea87e6fb944025649d8d25e0d09207bdd14ce73cfa/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/61a3bedb1f58b0329d222bea87e6fb944025649d8d25e0d09207bdd14ce73cfa/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6dc5e5141ce62779dacf4f2744a06ba9e1a17a6654025330954645ba85d67a52/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6dc5e5141ce62779dacf4f2744a06ba9e1a17a6654025330954645ba85d67a52/userdata/shm major:0 minor:212 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/73bff03f30594ab262c2a30b3780f160c74e33aca26f76b4bf5f52cba21e573c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/73bff03f30594ab262c2a30b3780f160c74e33aca26f76b4bf5f52cba21e573c/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/850412c45e2f8253cc12004c9127dfff47ca55ab64fedf4ee8bd3e1e6c3d6209/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/850412c45e2f8253cc12004c9127dfff47ca55ab64fedf4ee8bd3e1e6c3d6209/userdata/shm major:0 minor:340 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/851332dd3e2ab2ef739da568ce61db14561db576d866181b80d8500e7948b47c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/851332dd3e2ab2ef739da568ce61db14561db576d866181b80d8500e7948b47c/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8a1f3fb1db461a000f41a8bce00784f217d80bc29ff6cb7364b435a4cbf196cb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8a1f3fb1db461a000f41a8bce00784f217d80bc29ff6cb7364b435a4cbf196cb/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9785a3480d456a16bd34a23099a841ccf110d96d3f4d3ffb29fcd3e4ff56f216/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9785a3480d456a16bd34a23099a841ccf110d96d3f4d3ffb29fcd3e4ff56f216/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/af611a0e5a0907317b43fee654fd7f29e13a171511000a00c512c114f6b78560/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/af611a0e5a0907317b43fee654fd7f29e13a171511000a00c512c114f6b78560/userdata/shm major:0 minor:79 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c1b6289082c6a305f4d53814654f8b65a2203e5f4318764392c7c695087cc2ef/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c1b6289082c6a305f4d53814654f8b65a2203e5f4318764392c7c695087cc2ef/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d1c1af585cb274192fdc71ad26fc1a5aabd407f21222f2b6e3237dceb1bd9601/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d1c1af585cb274192fdc71ad26fc1a5aabd407f21222f2b6e3237dceb1bd9601/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d508448c01a0f15eb1f320f61b04eced18c10e700cc324c4398f462b85d670e2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d508448c01a0f15eb1f320f61b04eced18c10e700cc324c4398f462b85d670e2/userdata/shm major:0 minor:214 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d58ddf7f03d7429d555761fef4e0b116aa305dab8eb5da014086bbe4e36a3f79/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d58ddf7f03d7429d555761fef4e0b116aa305dab8eb5da014086bbe4e36a3f79/userdata/shm major:0 minor:83 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/db2144054853869ea8fea2b2ddadb92045e4d2e8447e0b7f99e0c85e1094b194/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/db2144054853869ea8fea2b2ddadb92045e4d2e8447e0b7f99e0c85e1094b194/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/dc1ded8268503c05969cb9d691fe4f9fb194693eeb55ce44ff4a14ff852cee73/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/dc1ded8268503c05969cb9d691fe4f9fb194693eeb55ce44ff4a14ff852cee73/userdata/shm major:0 minor:231 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0414a02f-19b2-46cc-bf3e-884656ddee63/volumes/kubernetes.io~projected/kube-api-access-rq95k:{mountpoint:/var/lib/kubelet/pods/0414a02f-19b2-46cc-bf3e-884656ddee63/volumes/kubernetes.io~projected/kube-api-access-rq95k major:0 minor:335 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0caf85ea-1bec-4670-a2e1-3cafd0e5a587/volumes/kubernetes.io~projected/kube-api-access-pqqmv:{mountpoint:/var/lib/kubelet/pods/0caf85ea-1bec-4670-a2e1-3cafd0e5a587/volumes/kubernetes.io~projected/kube-api-access-pqqmv major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0caf85ea-1bec-4670-a2e1-3cafd0e5a587/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/0caf85ea-1bec-4670-a2e1-3cafd0e5a587/volumes/kubernetes.io~secret/serving-cert major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/10a6a241-8eef-4bf1-b609-dd71d2042646/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/10a6a241-8eef-4bf1-b609-dd71d2042646/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/10a6a241-8eef-4bf1-b609-dd71d2042646/volumes/kubernetes.io~projected/kube-api-access-h6q9p:{mountpoint:/var/lib/kubelet/pods/10a6a241-8eef-4bf1-b609-dd71d2042646/volumes/kubernetes.io~projected/kube-api-access-h6q9p major:0 minor:233 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/10a6a241-8eef-4bf1-b609-dd71d2042646/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/10a6a241-8eef-4bf1-b609-dd71d2042646/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/10a6a241-8eef-4bf1-b609-dd71d2042646/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/10a6a241-8eef-4bf1-b609-dd71d2042646/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/10d51151-30e6-4c36-a13b-5af9c5ba56e8/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/10d51151-30e6-4c36-a13b-5af9c5ba56e8/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/12b0e63f-73f7-429a-879d-617267cc5f36/volumes/kubernetes.io~projected/kube-api-access-nlrxg:{mountpoint:/var/lib/kubelet/pods/12b0e63f-73f7-429a-879d-617267cc5f36/volumes/kubernetes.io~projected/kube-api-access-nlrxg major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/12b0e63f-73f7-429a-879d-617267cc5f36/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/12b0e63f-73f7-429a-879d-617267cc5f36/volumes/kubernetes.io~secret/default-certificate major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/12b0e63f-73f7-429a-879d-617267cc5f36/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/12b0e63f-73f7-429a-879d-617267cc5f36/volumes/kubernetes.io~secret/stats-auth major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66/volumes/kubernetes.io~projected/kube-api-access-kdnwh:{mountpoint:/var/lib/kubelet/pods/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66/volumes/kubernetes.io~projected/kube-api-access-kdnwh major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26f7336a-a2b6-4f80-b417-a9a5d1648d69/volumes/kubernetes.io~projected/kube-api-access-b6dwh:{mountpoint:/var/lib/kubelet/pods/26f7336a-a2b6-4f80-b417-a9a5d1648d69/volumes/kubernetes.io~projected/kube-api-access-b6dwh major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ef0f942-8c3c-43c9-bc45-a40b69188935/volumes/kubernetes.io~projected/kube-api-access-mh6ft:{mountpoint:/var/lib/kubelet/pods/2ef0f942-8c3c-43c9-bc45-a40b69188935/volumes/kubernetes.io~projected/kube-api-access-mh6ft major:0 minor:239 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ef0f942-8c3c-43c9-bc45-a40b69188935/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/2ef0f942-8c3c-43c9-bc45-a40b69188935/volumes/kubernetes.io~secret/cert major:0 minor:237 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2f2e4d96-73c8-4a18-b4f7-97387ed44645/volumes/kubernetes.io~projected/kube-api-access-4xhtw:{mountpoint:/var/lib/kubelet/pods/2f2e4d96-73c8-4a18-b4f7-97387ed44645/volumes/kubernetes.io~projected/kube-api-access-4xhtw major:0 minor:238 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/32072064-dcf7-4c58-a5ef-47eeadb245e5/volumes/kubernetes.io~projected/kube-api-access-27s7f:{mountpoint:/var/lib/kubelet/pods/32072064-dcf7-4c58-a5ef-47eeadb245e5/volumes/kubernetes.io~projected/kube-api-access-27s7f major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/32072064-dcf7-4c58-a5ef-47eeadb245e5/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/32072064-dcf7-4c58-a5ef-47eeadb245e5/volumes/kubernetes.io~secret/serving-cert major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34d75159-9865-405a-88fe-5cf738813dde/volumes/kubernetes.io~projected/kube-api-access-87dpc:{mountpoint:/var/lib/kubelet/pods/34d75159-9865-405a-88fe-5cf738813dde/volumes/kubernetes.io~projected/kube-api-access-87dpc major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/579ad6b2-cca6-4950-b2f2-1604e8757f1a/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/579ad6b2-cca6-4950-b2f2-1604e8757f1a/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/579ad6b2-cca6-4950-b2f2-1604e8757f1a/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/579ad6b2-cca6-4950-b2f2-1604e8757f1a/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/579ad6b2-cca6-4950-b2f2-1604e8757f1a/volumes/kubernetes.io~projected/kube-api-access-w7zf6:{mountpoint:/var/lib/kubelet/pods/579ad6b2-cca6-4950-b2f2-1604e8757f1a/volumes/kubernetes.io~projected/kube-api-access-w7zf6 major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/580c347a-163e-4e05-a1e4-497c10edb3ed/volumes/kubernetes.io~projected/kube-api-access-qkwbc:{mountpoint:/var/lib/kubelet/pods/580c347a-163e-4e05-a1e4-497c10edb3ed/volumes/kubernetes.io~projected/kube-api-access-qkwbc major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/69f0b08a-743a-441e-815c-015bcd833058/volumes/kubernetes.io~projected/kube-api-access-vmd2h:{mountpoint:/var/lib/kubelet/pods/69f0b08a-743a-441e-815c-015bcd833058/volumes/kubernetes.io~projected/kube-api-access-vmd2h major:0 minor:234 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c/volumes/kubernetes.io~projected/kube-api-access-8kjm9:{mountpoint:/var/lib/kubelet/pods/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c/volumes/kubernetes.io~projected/kube-api-access-8kjm9 major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6e6d73d7-6236-4642-9b4c-74940e54057a/volumes/kubernetes.io~projected/kube-api-access-shlzs:{mountpoint:/var/lib/kubelet/pods/6e6d73d7-6236-4642-9b4c-74940e54057a/volumes/kubernetes.io~projected/kube-api-access-shlzs major:0 minor:329 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262/volumes/kubernetes.io~projected/kube-api-access-j8p68:{mountpoint:/var/lib/kubelet/pods/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262/volumes/kubernetes.io~projected/kube-api-access-j8p68 major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/749ecc85-b28a-4ecd-aaf0-27de9c332713/volumes/kubernetes.io~projected/kube-api-access-5w6wx:{mountpoint:/var/lib/kubelet/pods/749ecc85-b28a-4ecd-aaf0-27de9c332713/volumes/kubernetes.io~projected/kube-api-access-5w6wx major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7ba6ecd5-1d02-4433-b245-1c957827467e/volumes/kubernetes.io~projected/kube-api-access-2sb99:{mountpoint:/var/lib/kubelet/pods/7ba6ecd5-1d02-4433-b245-1c957827467e/volumes/kubernetes.io~projected/kube-api-access-2sb99 major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7ba6ecd5-1d02-4433-b245-1c957827467e/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/7ba6ecd5-1d02-4433-b245-1c957827467e/volumes/kubernetes.io~secret/serving-cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/80c620b9-0db9-47a5-a843-99d81db2ef95/volumes/kubernetes.io~projected/kube-api-access-2f2jx:{mountpoint:/var/lib/kubelet/pods/80c620b9-0db9-47a5-a843-99d81db2ef95/volumes/kubernetes.io~projected/kube-api-access-2f2jx major:0 minor:361 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/80c620b9-0db9-47a5-a843-99d81db2ef95/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/80c620b9-0db9-47a5-a843-99d81db2ef95/volumes/kubernetes.io~secret/signing-key major:0 minor:360 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8322007d-27a3-43f8-b6d9-0d183f5e433f/volumes/kubernetes.io~projected/kube-api-access-wv4bv:{mountpoint:/var/lib/kubelet/pods/8322007d-27a3-43f8-b6d9-0d183f5e433f/volumes/kubernetes.io~projected/kube-api-access-wv4bv major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/836fc8fa-ebbb-4836-b453-2b9be6db8452/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/836fc8fa-ebbb-4836-b453-2b9be6db8452/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/836fc8fa-ebbb-4836-b453-2b9be6db8452/volumes/kubernetes.io~projected/kube-api-access-2zkk6:{mountpoint:/var/lib/kubelet/pods/836fc8fa-ebbb-4836-b453-2b9be6db8452/volumes/kubernetes.io~projected/kube-api-access-2zkk6 major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/836fc8fa-ebbb-4836-b453-2b9be6db8452/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/836fc8fa-ebbb-4836-b453-2b9be6db8452/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/836fc8fa-ebbb-4836-b453-2b9be6db8452/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/836fc8fa-ebbb-4836-b453-2b9be6db8452/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/88031944-e289-40ee-b002-884805e6bec6/volumes/kubernetes.io~projected/kube-api-access-pfgnv:{mountpoint:/var/lib/kubelet/pods/88031944-e289-40ee-b002-884805e6bec6/volumes/kubernetes.io~projected/kube-api-access-pfgnv major:0 minor:322 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8ea83f1f-61e7-4236-a5e7-08c079de313b/volumes/kubernetes.io~projected/kube-api-access-8mbh7:{mountpoint:/var/lib/kubelet/pods/8ea83f1f-61e7-4236-a5e7-08c079de313b/volumes/kubernetes.io~projected/kube-api-access-8mbh7 major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8ea83f1f-61e7-4236-a5e7-08c079de313b/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/8ea83f1f-61e7-4236-a5e7-08c079de313b/volumes/kubernetes.io~secret/serving-cert major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/951f5784-32a9-40a3-b503-33249c04d5fc/volumes/kubernetes.io~projected/kube-api-access-jp26q:{mountpoint:/var/lib/kubelet/pods/951f5784-32a9-40a3-b503-33249c04d5fc/volumes/kubernetes.io~projected/kube-api-access-jp26q major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98bb71f4-49c7-4216-b61e-f14b7b3a6368/volumes/kubernetes.io~projected/kube-api-access-lnfnt:{mountpoint:/var/lib/kubelet/pods/98bb71f4-49c7-4216-b61e-f14b7b3a6368/volumes/kubernetes.io~projected/kube-api-access-lnfnt major:0 minor:334 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9d47d6f3-b42c-4027-863e-e148d6d22726/volumes/kubernetes.io~projected/kube-api-access-2gw8x:{mountpoint:/var/lib/kubelet/pods/9d47d6f3-b42c-4027-863e-e148d6d22726/volumes/kubernetes.io~projected/kube-api-access-2gw8x major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a43a3fa1-f14d-4abc-95bb-1a1f21f25b01/volumes/kubernetes.io~projected/kube-api-access-4mmd9:{mountpoint:/var/lib/kubelet/pods/a43a3fa1-f14d-4abc-95bb-1a1f21f25b01/volumes/kubernetes.io~projected/kube-api-access-4mmd9 major:0 minor:235 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b6a6ef43-27ed-4be0-becd-e5f455be56a8/volumes/kubernetes.io~projected/kube-api-access-xzdj5:{mountpoint:/var/lib/kubelet/pods/b6a6ef43-27ed-4be0-becd-e5f455be56a8/volumes/kubernetes.io~projected/kube-api-access-xzdj5 major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf675d26-93c5-4a45-90db-7f95e260ac30/volumes/kubernetes.io~projected/kube-api-access-mhp4d:{mountpoint:/var/lib/kubelet/pods/cf675d26-93c5-4a45-90db-7f95e260ac30/volumes/kubernetes.io~projected/kube-api-access-mhp4d major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e4451ce6-8729-4567-9e85-d5eba0db6139/volumes/kubernetes.io~projected/kube-api-access-mp727:{mountpoint:/var/lib/kubelet/pods/e4451ce6-8729-4567-9e85-d5eba0db6139/volumes/kubernetes.io~projected/kube-api-access-mp727 major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e8ba695c-5928-49ec-9040-3e5171c81b4b/volumes/kubernetes.io~projected/kube-api-access-n2m6j:{mountpoint:/var/lib/kubelet/pods/e8ba695c-5928-49ec-9040-3e5171c81b4b/volumes/kubernetes.io~projected/kube-api-access-n2m6j major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f11f9269-8c8d-43da-a7f6-c766c17793c4/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/f11f9269-8c8d-43da-a7f6-c766c17793c4/volumes/kubernetes.io~secret/agent-certs major:0 minor:65 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/f30365575736e7c199398402011d8cd723941fda5be91b6185c31949eaa92e5c/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/3d8bf3f5571d2674e91f30349f214e07d31bd083ac8e7f1dc203c020379b2ea2/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/c141ee2aacacc7e10a7b21bef6fff0e706226bfc3133009c6e04468ff5533a72/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/0b5a2a4a1166fc8cd9d41414aee89062fc61dc824aea1230016404524020ea5f/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-113:{mountpoint:/var/lib/containers/storage/overlay/22a9f123bdadf33a7f82b266d2a6ce61cd7fa54b58c26e567c861d16b0c1c000/merged major:0 minor:113 fsType:overlay blockSize:0} overlay_0-118:{mountpoint:/var/lib/containers/storage/overlay/9c5e6fc0f8bab3d1ad38f072715663d7ac88adcd86b35a83d89f9dcc128ab87f/merged major:0 minor:118 fsType:overlay blockSize:0} overlay_0-121:{mountpoint:/var/lib/containers/storage/overlay/b8e47127af875e4d230a9a669d48b5b24f5f5fcf75dbfc6c44560ccf3d2422d8/merged major:0 minor:121 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/ee9787d27dbb33a98b71e93da216ae42170b2d4f820d4f3702f71b0a951ac117/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/a7c3d975ca79ea92c20087328062b6dde2da8c69be85aebafe9e665fc32807b4/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/1ddb2bb6558d19ab3149b4553b3a85730b1056f1c7ff67beda77978c2e2425ca/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/2cb9a6abfde612c692e2c935b30b058a20e3b65762be2c9da9fd73466a56d6eb/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/e1ecd0353891ed1d88f0ffb5fd80a6e818daa14ace8b345fdd9b13720d591bbb/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-149:{mountpoint:/var/lib/containers/storage/overlay/240c78590640bfce98d9695d1cddbd39269faf5e17b021ff03cc365f063d6a0b/merged major:0 minor:149 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/7f5754a25c8d4159409df09c11b3245e01f3da3c8280ae7964632bf539038079/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/938ae7542fca5bc8079b4e2a91aa9d9b783df43689cb933bd6f2d90f1cf071b2/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/ef09d068e465efc3191534c2c8127a440965faf48101cc0b1aa40b6b05869d79/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/7d1a870b3ab65c5e989875409273a779350ec5f6f0cf74255d33023f98370d6f/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/4e712567db10f1aa9117c73e4f6eb3c009ad764efc6b2a4449eaf796e34cc656/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/6bc43e597cd3aa19a5bb28acf1fbabf56dce9050ba1862afc5c226edcace2812/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/3a9efed909f2902e674d7ce15d672f967ccf55fc4ac66685741c495de7ca11a7/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/3a9b5b33fa7b68d04bf68b703e7b1045d3ec0482b975ea99e489924e018d5b74/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/228d41bfc124900fc4e5789935555f545846de7fa8a31c7aab72593ef83df742/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/78a7ca96b25c4b2eeda748c27ccbd25ba2d38ca544e9c86bcc19835a392206b7/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/3bb0c53c1af34b749ff3b8e0acfe73f9a30a3324939256b21d8cdcbbdaee45b8/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/aac93fe6ce2e2edb0a6a84341eb3819f3c3c662039f33bcf070f20fd0f143100/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/8349cc71cffd72cb0381ab660cf8789c19f635b098bd207e6cded7a40c9538c6/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/e603601a901214a57e0ea78384551690596b941e599d764102a4d8b76f45cece/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/4434247a52227b0a03b9cdfe59c80a38063eeda3b3bac5081d48366407dab64c/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/332c9837856eb58bc52b278a640f4321a82cf60e6591f2ae8819e551981e66fa/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/ceb1c695bef2d92071fee3f3fb171894809614bb417cc98171717802de514a4c/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-274:{mountpoint:/var/lib/containers/storage/overlay/c77cafe7aa528a55e7e0eb8662cb6b08d126f53027d26ba40822c10c187602de/merged major:0 minor:274 fsType:overlay blockSize:0} overlay_0-276:{mountpoint:/var/lib/containers/storage/overlay/56a07aacc2e5bb6406813b2fa77b3a4ef30eb581dc77a1fb72ad6da9709c123b/merged major:0 minor:276 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/ccf10976a5ba024c5f396d68cacd75176ddae427fdb4ffbecb4f2bda8a97467d/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-283:{mountpoint:/var/lib/containers/storage/overlay/8f655d9a407f94f8b4c460124cf9df06c25bab7f2779d236199e958a1219b39c/merged major:0 minor:283 fsType:overlay blockSize:0} overlay_0-292:{mountpoint:/var/lib/containers/storage/overlay/1bef2a8223882b7976efd118f558238e5024934dd79a1cbeb87a0e44d1781c4d/merged major:0 minor:292 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/2da4dd6caf96fccef4e692a5d61c194e5f4b918aaf2604cae6565bab34fa15b3/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-296:{mountpoint:/var/lib/containers/storage/overlay/358b56f0b66ba74ec069d244591f87df837c83d0a613dd40590fff83aeff039a/merged major:0 minor:296 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/950f30bcad2908f765650e9a585253a878d0c474c890688daf8903fc424ce979/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/7caa5f6b06eff61697152c453b7e96f12e3ba706b73d99916aa591fe51a17443/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/841a59e37f09f3c1fb5d2d73d32dd1bb20a9b8d3a4b1051646c030579cca7347/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-316:{mountpoint:/var/lib/containers/storage/overlay/2926b78d758e3395e1c9dae157399d418cb7c39f82fe60d87f3e4cc8aa3c929f/merged major:0 minor:316 fsType:overlay blockSize:0} overlay_0-327:{mountpoint:/var/lib/containers/storage/overlay/dae567a5939783624b4470d62b1db51d3494e2301551ecb2289cae681a2d9e2b/merged major:0 minor:327 fsType:overlay blockSize:0} overlay_0-342:{mountpoint:/var/lib/containers/storage/overlay/2058c4a7d65418df030d50b229e29f65424c5f1bbc62349ae00bf89ebb8f1566/merged major:0 minor:342 fsType:overlay blockSize:0} overlay_0-344:{mountpoint:/var/lib/containers/storage/overlay/f67d28cb3a968e60d6ed8d5ffc0a583a9fe59bab4f7a54c00756b285378e3d1c/merged major:0 minor:344 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/708c095fc572ed8f30e0e682d1838c0bd9433a03a9cc02b7aca27960e4cf318a/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-351:{mountpoint:/var/lib/containers/storage/overlay/f0b2a6ee0e94e6aa7756437d0f8e0f16646c831876bf75db5664c113da71f67b/merged major:0 minor:351 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/ed5e090c13723e7547297bfade7411cb99db7f7a9291f3a8784b80828e4c821d/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-364:{mountpoint:/var/lib/containers/storage/overlay/79d8919e181e26e8e189fc5c0ab5d50e73c7cd21b79d541411deebeeb3cf38ef/merged major:0 minor:364 fsType:overlay blockSize:0} overlay_0-366:{mountpoint:/var/lib/containers/storage/overlay/483d92a9741d72f3af40cc35d5382bb54291d99633286f38b798c9253f0389f2/merged major:0 minor:366 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/0a06f6263e5f22771bed1f809ca806581b7f5e62152bf0bb2ac5376ecbc5fd41/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/022397a44df2099afda092f0688fad70efc614c61f56ae844f4ec013c59b3e36/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/4f045ed949d675085c76964501404c88bf98899dedf2c143cc23ac69c9a29871/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/7fc9b9340a3b8e518c1eb429cf1dad7f7212c6b467f35238a97d74f0fea535b1/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/a4a12b0cdb417e163da6a55f7c6dda4c7e819bd632d096e2469055576fa0c5e7/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/fe3010560e547a20e5ba11dd3247068977a85a7706e26d704c2487f032bca503/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-81:{mountpoint:/var/lib/containers/storage/overlay/9ba6ddad6446f26a5c4a014600f4c6d2555c999182ef9205882a3390b2de3c37/merged major:0 minor:81 fsType:overlay blockSize:0} overlay_0-85:{mountpoint:/var/lib/containers/storage/overlay/39d0ff02bb81b14e7399b7efdc2c0bfd128be996b6175941f4046b6c09db5aac/merged major:0 minor:85 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/95566f8bdd57d3b4a937c56c68f0d41faf95e205398b36b59c262bde2ca9f1bf/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/47959bba995529299d1abaab63c88c79bf74430c60af88d02689ea1397f670d3/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/fd2e05acc17b9f26fb43692cd8efc400a83f826c78f84523b183345f61105e67/merged major:0 minor:96 fsType:overlay blockSize:0}]
Nov 03 17:16:39.895401 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.895011    5021 manager.go:217] Machine: {Timestamp:2026-11-03 17:16:39.894509005 +0000 UTC m=+0.095847048 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100604 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a53e49d45af4949e1068954b9d4f5 SystemUUID:ec2a53e4-9d45-af49-49e1-068954b9d4f5 BootID:a7e901dc-a995-419f-9c02-ef9997ddf1bf Filesystems:[{Device:/var/lib/kubelet/pods/8322007d-27a3-43f8-b6d9-0d183f5e433f/volumes/kubernetes.io~projected/kube-api-access-wv4bv DeviceMajor:0 DeviceMinor:67 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/73bff03f30594ab262c2a30b3780f160c74e33aca26f76b4bf5f52cba21e573c/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8ea83f1f-61e7-4236-a5e7-08c079de313b/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:206 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/10a6a241-8eef-4bf1-b609-dd71d2042646/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:236 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2f2e4d96-73c8-4a18-b4f7-97387ed44645/volumes/kubernetes.io~projected/kube-api-access-4xhtw DeviceMajor:0 DeviceMinor:238 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/580c347a-163e-4e05-a1e4-497c10edb3ed/volumes/kubernetes.io~projected/kube-api-access-qkwbc DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/af611a0e5a0907317b43fee654fd7f29e13a171511000a00c512c114f6b78560/userdata/shm DeviceMajor:0 DeviceMinor:79 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/10a6a241-8eef-4bf1-b609-dd71d2042646/volumes/kubernetes.io~projected/kube-api-access-h6q9p DeviceMajor:0 DeviceMinor:233 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3a671b0882cfc6d4e2490726bb229dc55d2acd6ef7a4395c73d20862b450f2a9/userdata/shm DeviceMajor:0 DeviceMinor:290 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-351 DeviceMajor:0 DeviceMinor:351 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/579ad6b2-cca6-4950-b2f2-1604e8757f1a/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-118 DeviceMajor:0 DeviceMinor:118 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c/volumes/kubernetes.io~projected/kube-api-access-8kjm9 DeviceMajor:0 DeviceMinor:62 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/dc1ded8268503c05969cb9d691fe4f9fb194693eeb55ce44ff4a14ff852cee73/userdata/shm DeviceMajor:0 DeviceMinor:231 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-344 DeviceMajor:0 DeviceMinor:344 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/579ad6b2-cca6-4950-b2f2-1604e8757f1a/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/472ba7557e4d165c27da4a0eda01ae8b90cb3d6f686af8c9421a9e5373717633/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b6a6ef43-27ed-4be0-becd-e5f455be56a8/volumes/kubernetes.io~projected/kube-api-access-xzdj5 DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-113 DeviceMajor:0 DeviceMinor:113 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/836fc8fa-ebbb-4836-b453-2b9be6db8452/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:219 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0414a02f-19b2-46cc-bf3e-884656ddee63/volumes/kubernetes.io~projected/kube-api-access-rq95k DeviceMajor:0 DeviceMinor:335 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/38baf321624c1d4da7ec24d274eb2fd6811487320a1e70637d82c0322b203dcb/userdata/shm DeviceMajor:0 DeviceMinor:338 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/26f7336a-a2b6-4f80-b417-a9a5d1648d69/volumes/kubernetes.io~projected/kube-api-access-b6dwh DeviceMajor:0 DeviceMinor:64 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e8ba695c-5928-49ec-9040-3e5171c81b4b/volumes/kubernetes.io~projected/kube-api-access-n2m6j DeviceMajor:0 DeviceMinor:66 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/951f5784-32a9-40a3-b503-33249c04d5fc/volumes/kubernetes.io~projected/kube-api-access-jp26q DeviceMajor:0 DeviceMinor:204 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/12b0e63f-73f7-429a-879d-617267cc5f36/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:211 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/182ee7d4156bcaaadb6e5e265c14fc1918dbc7868aa56cbb7dc5ec0254b5b48b/userdata/shm DeviceMajor:0 DeviceMinor:222 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66/volumes/kubernetes.io~projected/kube-api-access-kdnwh DeviceMajor:0 DeviceMinor:230 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/db2144054853869ea8fea2b2ddadb92045e4d2e8447e0b7f99e0c85e1094b194/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-276 DeviceMajor:0 DeviceMinor:276 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6dc5e5141ce62779dacf4f2744a06ba9e1a17a6654025330954645ba85d67a52/userdata/shm DeviceMajor:0 DeviceMinor:212 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/12b0e63f-73f7-429a-879d-617267cc5f36/volumes/kubernetes.io~projected/kube-api-access-nlrxg DeviceMajor:0 DeviceMinor:220 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-342 DeviceMajor:0 DeviceMinor:342 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/836fc8fa-ebbb-4836-b453-2b9be6db8452/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0caf85ea-1bec-4670-a2e1-3cafd0e5a587/volumes/kubernetes.io~projected/kube-api-access-pqqmv DeviceMajor:0 DeviceMinor:205 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2ef0f942-8c3c-43c9-bc45-a40b69188935/volumes/kubernetes.io~projected/kube-api-access-mh6ft DeviceMajor:0 DeviceMinor:239 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6e6d73d7-6236-4642-9b4c-74940e54057a/volumes/kubernetes.io~projected/kube-api-access-shlzs DeviceMajor:0 DeviceMinor:329 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/579ad6b2-cca6-4950-b2f2-1604e8757f1a/volumes/kubernetes.io~projected/kube-api-access-w7zf6 DeviceMajor:0 DeviceMinor:63 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-149 DeviceMajor:0 DeviceMinor:149 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/32072064-dcf7-4c58-a5ef-47eeadb245e5/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:207 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/32072064-dcf7-4c58-a5ef-47eeadb245e5/volumes/kubernetes.io~projected/kube-api-access-27s7f DeviceMajor:0 DeviceMinor:216 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/48845cd48640879501870b3082845c2d1a1eea2d9a42ee3ec23a1f744c30baed/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/836fc8fa-ebbb-4836-b453-2b9be6db8452/volumes/kubernetes.io~projected/kube-api-access-2zkk6 DeviceMajor:0 DeviceMinor:218 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e4451ce6-8729-4567-9e85-d5eba0db6139/volumes/kubernetes.io~projected/kube-api-access-mp727 DeviceMajor:0 DeviceMinor:221 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f11f9269-8c8d-43da-a7f6-c766c17793c4/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:65 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/153016ed6485aedbabcaf14789c3495ba2c493ba4b00ea2811a98926383388a4/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-316 DeviceMajor:0 DeviceMinor:316 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/836fc8fa-ebbb-4836-b453-2b9be6db8452/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:210 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-274 DeviceMajor:0 DeviceMinor:274 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-327 DeviceMajor:0 DeviceMinor:327 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c1b6289082c6a305f4d53814654f8b65a2203e5f4318764392c7c695087cc2ef/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-296 DeviceMajor:0 DeviceMinor:296 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/167ca99aaa60a0330071a09ecf9dd7bcdb37b420afb38b9cae7140754b9cb71c/userdata/shm DeviceMajor:0 DeviceMinor:336 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-85 DeviceMajor:0 DeviceMinor:85 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/12b0e63f-73f7-429a-879d-617267cc5f36/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:209 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-292 DeviceMajor:0 DeviceMinor:292 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-364 DeviceMajor:0 DeviceMinor:364 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7ba6ecd5-1d02-4433-b245-1c957827467e/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/01fa94ee14816352d717f70b921db29a366f22bc7a92e77a4b829b1d6dbe48a3/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/34d75159-9865-405a-88fe-5cf738813dde/volumes/kubernetes.io~projected/kube-api-access-87dpc DeviceMajor:0 DeviceMinor:286 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/10a6a241-8eef-4bf1-b609-dd71d2042646/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:227 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/88031944-e289-40ee-b002-884805e6bec6/volumes/kubernetes.io~projected/kube-api-access-pfgnv DeviceMajor:0 DeviceMinor:322 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/80c620b9-0db9-47a5-a843-99d81db2ef95/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:360 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/80c620b9-0db9-47a5-a843-99d81db2ef95/volumes/kubernetes.io~projected/kube-api-access-2f2jx DeviceMajor:0 DeviceMinor:361 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cf675d26-93c5-4a45-90db-7f95e260ac30/volumes/kubernetes.io~projected/kube-api-access-mhp4d DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/10a6a241-8eef-4bf1-b609-dd71d2042646/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:226 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/69f0b08a-743a-441e-815c-015bcd833058/volumes/kubernetes.io~projected/kube-api-access-vmd2h DeviceMajor:0 DeviceMinor:234 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5cd9cb85581dcd0a9b6397a8cd65e81ebd50e6f4ea49651dc7868e1e3283e038/userdata/shm DeviceMajor:0 DeviceMinor:362 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/61a3bedb1f58b0329d222bea87e6fb944025649d8d25e0d09207bdd14ce73cfa/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/9d47d6f3-b42c-4027-863e-e148d6d22726/volumes/kubernetes.io~projected/kube-api-access-2gw8x DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d1c1af585cb274192fdc71ad26fc1a5aabd407f21222f2b6e3237dceb1bd9601/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2fb9254e65b9145bb5a84caa9b1bb152abbe58598b653795e58cae8fb7d2685d/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/39089e125d6e2237461529f1ba3bbd05b228a3e102e55a4ac8adf75c8472de14/userdata/shm DeviceMajor:0 DeviceMinor:224 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a43a3fa1-f14d-4abc-95bb-1a1f21f25b01/volumes/kubernetes.io~projected/kube-api-access-4mmd9 DeviceMajor:0 DeviceMinor:235 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/850412c45e2f8253cc12004c9127dfff47ca55ab64fedf4ee8bd3e1e6c3d6209/userdata/shm DeviceMajor:0 DeviceMinor:340 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-81 DeviceMajor:0 DeviceMinor:81 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7ba6ecd5-1d02-4433-b245-1c957827467e/volumes/kubernetes.io~projected/kube-api-access-2sb99 DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d508448c01a0f15eb1f320f61b04eced18c10e700cc324c4398f462b85d670e2/userdata/shm DeviceMajor:0 DeviceMinor:214 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0caf85ea-1bec-4670-a2e1-3cafd0e5a587/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/749ecc85-b28a-4ecd-aaf0-27de9c332713/volumes/kubernetes.io~projected/kube-api-access-5w6wx DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8ea83f1f-61e7-4236-a5e7-08c079de313b/volumes/kubernetes.io~projected/kube-api-access-8mbh7 DeviceMajor:0 DeviceMinor:217 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/851332dd3e2ab2ef739da568ce61db14561db576d866181b80d8500e7948b47c/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8a1f3fb1db461a000f41a8bce00784f217d80bc29ff6cb7364b435a4cbf196cb/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262/volumes/kubernetes.io~projected/kube-api-access-j8p68 DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9785a3480d456a16bd34a23099a841ccf110d96d3f4d3ffb29fcd3e4ff56f216/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-283 DeviceMajor:0 DeviceMinor:283 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3a9d8a3ed6d1b22fb2e5162de99c708236e814e47812cc5d2ab98ca78ba11293/userdata/shm DeviceMajor:0 DeviceMinor:288 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-366 DeviceMajor:0 DeviceMinor:366 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-121 DeviceMajor:0 DeviceMinor:121 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/10d51151-30e6-4c36-a13b-5af9c5ba56e8/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:287 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/98bb71f4-49c7-4216-b61e-f14b7b3a6368/volumes/kubernetes.io~projected/kube-api-access-lnfnt DeviceMajor:0 DeviceMinor:334 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d58ddf7f03d7429d555761fef4e0b116aa305dab8eb5da014086bbe4e36a3f79/userdata/shm DeviceMajor:0 DeviceMinor:83 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2ef0f942-8c3c-43c9-bc45-a40b69188935/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:237 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:01fa94ee1481635 MacAddress:ba:a9:5a:82:56:65 Speed:10000 Mtu:8901} {Name:167ca99aaa60a03 MacAddress:5e:f8:ae:10:3b:67 Speed:10000 Mtu:8901} {Name:182ee7d4156bcaa MacAddress:0e:14:50:cd:cc:fd Speed:10000 Mtu:8901} {Name:38baf321624c1d4 MacAddress:ce:85:7f:51:ea:36 Speed:10000 Mtu:8901} {Name:39089e125d6e223 MacAddress:36:8e:97:5f:6f:b9 Speed:10000 Mtu:8901} {Name:3a671b0882cfc6d MacAddress:a6:45:5a:c9:e3:82 Speed:10000 Mtu:8901} {Name:3a9d8a3ed6d1b22 MacAddress:02:6b:f2:c1:6f:ec Speed:10000 Mtu:8901} {Name:472ba7557e4d165 MacAddress:0e:8b:0f:08:db:56 Speed:10000 Mtu:8901} {Name:5cd9cb85581dcd0 MacAddress:92:0e:89:54:b0:db Speed:10000 Mtu:8901} {Name:6dc5e5141ce6277 MacAddress:42:ee:c4:8a:35:02 Speed:10000 Mtu:8901} {Name:850412c45e2f825 MacAddress:a6:1c:e8:52:6f:a2 Speed:10000 Mtu:8901} {Name:851332dd3e2ab2e MacAddress:82:b3:a6:a8:e6:a0 Speed:10000 Mtu:8901} {Name:9785a3480d456a1 MacAddress:f6:59:a0:98:82:a9 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:06:ff:e5:87:45:5d Speed:0 Mtu:9001} {Name:br-int MacAddress:06:0d:57:d4:5d:28 Speed:0 Mtu:8901} {Name:d508448c01a0f15 MacAddress:3a:db:20:39:ba:5a Speed:10000 Mtu:8901} {Name:db2144054853869 MacAddress:32:d3:cf:6b:4a:5b Speed:10000 Mtu:8901} {Name:dc1ded8268503c0 MacAddress:46:aa:e1:56:0a:f9 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:06:ff:e5:87:45:5d Speed:0 Mtu:9001} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:16:c9:f6:a5:24:af Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 03 17:16:39.895663 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.895407    5021 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 03 17:16:39.895663 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.895458    5021 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 03 17:16:39.895793 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.895766    5021 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 03 17:16:39.895927 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.895794    5021 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-219.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 03 17:16:39.895976 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.895929    5021 topology_manager.go:143] "Creating topology manager with none policy"
Nov 03 17:16:39.895976 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.895938    5021 container_manager_linux.go:311] "Creating device plugin manager"
Nov 03 17:16:39.895976 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.895952    5021 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 03 17:16:39.895976 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.895966    5021 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 03 17:16:39.896094 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.895985    5021 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 03 17:16:39.896154 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.896143    5021 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 03 17:16:39.896277 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.896265    5021 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 03 17:16:39.896324 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.896304    5021 kubelet.go:493] "Attempting to sync node with API server"
Nov 03 17:16:39.896324 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.896314    5021 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 03 17:16:39.896324 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.896325    5021 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 03 17:16:39.896411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.896334    5021 kubelet.go:405] "Adding apiserver pod source"
Nov 03 17:16:39.896411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.896349    5021 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 03 17:16:39.897073 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.897061    5021 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 03 17:16:39.897073 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.897074    5021 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 03 17:16:39.897625 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.897603    5021 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 03 17:16:39.953708 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.953682    5021 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 03 17:16:39.953708 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.953703    5021 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 03 17:16:39.953922 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.953847    5021 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 03 17:16:39.954123 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.954106    5021 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 03 17:16:39.954199 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.954147    5021 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 03 17:16:39.954303 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.954291    5021 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 03 17:16:39.954359 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.954310    5021 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 03 17:16:39.954359 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.954321    5021 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 03 17:16:39.954359 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.954333    5021 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 03 17:16:39.954359 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.954343    5021 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 03 17:16:39.954359 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.954352    5021 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 03 17:16:39.954583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.954361    5021 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 03 17:16:39.954583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.954370    5021 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 03 17:16:39.954583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.954382    5021 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 03 17:16:39.954583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.954391    5021 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 03 17:16:39.954583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.954412    5021 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 03 17:16:39.954583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.954428    5021 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 03 17:16:39.954583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.954470    5021 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 03 17:16:39.954583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.954482    5021 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 03 17:16:39.958239 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.958204    5021 server.go:1263] "Started kubelet"
Nov 03 17:16:39.958338 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.958301    5021 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 03 17:16:39.958763 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.958336    5021 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 03 17:16:39.958763 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.958555    5021 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 03 17:16:39.958821 ip-10-0-137-219 systemd[1]: Started Kubernetes Kubelet.
Nov 03 17:16:39.959556 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.959019    5021 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 03 17:16:39.960461 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.960443    5021 server.go:317] "Adding debug handlers to kubelet server"
Nov 03 17:16:39.964267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.964249    5021 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 03 17:16:39.967045 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.964787    5021 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 03 17:16:39.967045 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.965610    5021 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 17:10:58 +0000 UTC" deadline="2028-08-05 12:19:30.152438886 +0000 UTC"
Nov 03 17:16:39.967045 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.965649    5021 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15379h2m50.186794368s"
Nov 03 17:16:39.967045 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.965690    5021 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 03 17:16:39.967045 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.965730    5021 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 03 17:16:39.967045 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:39.965762    5021 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:16:39.967045 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.965798    5021 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 03 17:16:39.967045 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.966066    5021 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 03 17:16:39.967045 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.966079    5021 factory.go:55] Registering systemd factory
Nov 03 17:16:39.967045 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.966089    5021 factory.go:223] Registration of the systemd container factory successfully
Nov 03 17:16:39.968103 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968080    5021 factory.go:153] Registering CRI-O factory
Nov 03 17:16:39.968103 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968107    5021 factory.go:223] Registration of the crio container factory successfully
Nov 03 17:16:39.968309 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968142    5021 factory.go:103] Registering Raw factory
Nov 03 17:16:39.968309 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968178    5021 manager.go:1199] Started watching for new ooms in manager
Nov 03 17:16:39.968536 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968522    5021 manager.go:319] Starting recovery of all containers
Nov 03 17:16:39.968610 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968553    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6e6d73d7-6236-4642-9b4c-74940e54057a" volumeName="kubernetes.io/empty-dir/6e6d73d7-6236-4642-9b4c-74940e54057a-archives-path" seLinuxMountContext=""
Nov 03 17:16:39.968610 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968582    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2f2e4d96-73c8-4a18-b4f7-97387ed44645" volumeName="kubernetes.io/projected/2f2e4d96-73c8-4a18-b4f7-97387ed44645-kube-api-access-4xhtw" seLinuxMountContext=""
Nov 03 17:16:39.968610 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968593    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2f2e4d96-73c8-4a18-b4f7-97387ed44645" volumeName="kubernetes.io/configmap/2f2e4d96-73c8-4a18-b4f7-97387ed44645-config-volume" seLinuxMountContext=""
Nov 03 17:16:39.968610 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968605    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2f2e4d96-73c8-4a18-b4f7-97387ed44645" volumeName="kubernetes.io/empty-dir/2f2e4d96-73c8-4a18-b4f7-97387ed44645-tmp-dir" seLinuxMountContext=""
Nov 03 17:16:39.968798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968619    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="951f5784-32a9-40a3-b503-33249c04d5fc" volumeName="kubernetes.io/projected/951f5784-32a9-40a3-b503-33249c04d5fc-kube-api-access-jp26q" seLinuxMountContext=""
Nov 03 17:16:39.968798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968630    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf675d26-93c5-4a45-90db-7f95e260ac30" volumeName="kubernetes.io/projected/cf675d26-93c5-4a45-90db-7f95e260ac30-kube-api-access-mhp4d" seLinuxMountContext=""
Nov 03 17:16:39.968798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968642    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f11f9269-8c8d-43da-a7f6-c766c17793c4" volumeName="kubernetes.io/secret/f11f9269-8c8d-43da-a7f6-c766c17793c4-agent-certs" seLinuxMountContext=""
Nov 03 17:16:39.968798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968655    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12b0e63f-73f7-429a-879d-617267cc5f36" volumeName="kubernetes.io/projected/12b0e63f-73f7-429a-879d-617267cc5f36-kube-api-access-nlrxg" seLinuxMountContext=""
Nov 03 17:16:39.968798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968669    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ef0f942-8c3c-43c9-bc45-a40b69188935" volumeName="kubernetes.io/projected/2ef0f942-8c3c-43c9-bc45-a40b69188935-kube-api-access-mh6ft" seLinuxMountContext=""
Nov 03 17:16:39.968798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968680    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34d75159-9865-405a-88fe-5cf738813dde" volumeName="kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc" seLinuxMountContext=""
Nov 03 17:16:39.968798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968693    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c" volumeName="kubernetes.io/projected/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-kube-api-access-8kjm9" seLinuxMountContext=""
Nov 03 17:16:39.968798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968704    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="70c6fee2-4568-4dfc-85ff-cfd1fc1c8262" volumeName="kubernetes.io/projected/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-kube-api-access-j8p68" seLinuxMountContext=""
Nov 03 17:16:39.968798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968716    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88031944-e289-40ee-b002-884805e6bec6" volumeName="kubernetes.io/projected/88031944-e289-40ee-b002-884805e6bec6-kube-api-access-pfgnv" seLinuxMountContext=""
Nov 03 17:16:39.968798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968727    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ea83f1f-61e7-4236-a5e7-08c079de313b" volumeName="kubernetes.io/secret/8ea83f1f-61e7-4236-a5e7-08c079de313b-serving-cert" seLinuxMountContext=""
Nov 03 17:16:39.968798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968767    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b6a6ef43-27ed-4be0-becd-e5f455be56a8" volumeName="kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 03 17:16:39.968798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968778    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0caf85ea-1bec-4670-a2e1-3cafd0e5a587" volumeName="kubernetes.io/configmap/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-config" seLinuxMountContext=""
Nov 03 17:16:39.968798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968789    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="10a6a241-8eef-4bf1-b609-dd71d2042646" volumeName="kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-installation-pull-secrets" seLinuxMountContext=""
Nov 03 17:16:39.968798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968801    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66" volumeName="kubernetes.io/projected/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-kube-api-access-kdnwh" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968815    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="580c347a-163e-4e05-a1e4-497c10edb3ed" volumeName="kubernetes.io/configmap/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-daemon-config" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968826    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="580c347a-163e-4e05-a1e4-497c10edb3ed" volumeName="kubernetes.io/projected/580c347a-163e-4e05-a1e4-497c10edb3ed-kube-api-access-qkwbc" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968850    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b6a6ef43-27ed-4be0-becd-e5f455be56a8" volumeName="kubernetes.io/projected/b6a6ef43-27ed-4be0-becd-e5f455be56a8-kube-api-access-xzdj5" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968861    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="32072064-dcf7-4c58-a5ef-47eeadb245e5" volumeName="kubernetes.io/projected/32072064-dcf7-4c58-a5ef-47eeadb245e5-kube-api-access-27s7f" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968872    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0caf85ea-1bec-4670-a2e1-3cafd0e5a587" volumeName="kubernetes.io/secret/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-serving-cert" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968884    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="579ad6b2-cca6-4950-b2f2-1604e8757f1a" volumeName="kubernetes.io/empty-dir/579ad6b2-cca6-4950-b2f2-1604e8757f1a-tmp" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968896    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="836fc8fa-ebbb-4836-b453-2b9be6db8452" volumeName="kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-bound-sa-token" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968906    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4451ce6-8729-4567-9e85-d5eba0db6139" volumeName="kubernetes.io/configmap/e4451ce6-8729-4567-9e85-d5eba0db6139-telemetry-config" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968921    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12b0e63f-73f7-429a-879d-617267cc5f36" volumeName="kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-default-certificate" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968948    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6e6d73d7-6236-4642-9b4c-74940e54057a" volumeName="kubernetes.io/projected/6e6d73d7-6236-4642-9b4c-74940e54057a-kube-api-access-shlzs" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.968964    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="749ecc85-b28a-4ecd-aaf0-27de9c332713" volumeName="kubernetes.io/projected/749ecc85-b28a-4ecd-aaf0-27de9c332713-kube-api-access-5w6wx" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969034    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ba6ecd5-1d02-4433-b245-1c957827467e" volumeName="kubernetes.io/projected/7ba6ecd5-1d02-4433-b245-1c957827467e-kube-api-access-2sb99" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969049    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="836fc8fa-ebbb-4836-b453-2b9be6db8452" volumeName="kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-trusted-ca" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969060    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e8ba695c-5928-49ec-9040-3e5171c81b4b" volumeName="kubernetes.io/empty-dir/e8ba695c-5928-49ec-9040-3e5171c81b4b-tmp-dir" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969074    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="10a6a241-8eef-4bf1-b609-dd71d2042646" volumeName="kubernetes.io/empty-dir/10a6a241-8eef-4bf1-b609-dd71d2042646-ca-trust-extracted" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969085    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ba6ecd5-1d02-4433-b245-1c957827467e" volumeName="kubernetes.io/configmap/7ba6ecd5-1d02-4433-b245-1c957827467e-config" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969095    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="836fc8fa-ebbb-4836-b453-2b9be6db8452" volumeName="kubernetes.io/empty-dir/836fc8fa-ebbb-4836-b453-2b9be6db8452-ca-trust-extracted" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969107    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ea83f1f-61e7-4236-a5e7-08c079de313b" volumeName="kubernetes.io/configmap/8ea83f1f-61e7-4236-a5e7-08c079de313b-trusted-ca-bundle" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969144    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a43a3fa1-f14d-4abc-95bb-1a1f21f25b01" volumeName="kubernetes.io/projected/a43a3fa1-f14d-4abc-95bb-1a1f21f25b01-kube-api-access-4mmd9" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969156    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69f0b08a-743a-441e-815c-015bcd833058" volumeName="kubernetes.io/projected/69f0b08a-743a-441e-815c-015bcd833058-kube-api-access-vmd2h" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969185    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="70c6fee2-4568-4dfc-85ff-cfd1fc1c8262" volumeName="kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovnkube-script-lib" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969198    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="32072064-dcf7-4c58-a5ef-47eeadb245e5" volumeName="kubernetes.io/configmap/32072064-dcf7-4c58-a5ef-47eeadb245e5-config" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969209    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0414a02f-19b2-46cc-bf3e-884656ddee63" volumeName="kubernetes.io/projected/0414a02f-19b2-46cc-bf3e-884656ddee63-kube-api-access-rq95k" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969235    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0caf85ea-1bec-4670-a2e1-3cafd0e5a587" volumeName="kubernetes.io/projected/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-kube-api-access-pqqmv" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969248    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="10a6a241-8eef-4bf1-b609-dd71d2042646" volumeName="kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-kube-api-access-h6q9p" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969259    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66" volumeName="kubernetes.io/configmap/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-config" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969266    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b6a6ef43-27ed-4be0-becd-e5f455be56a8" volumeName="kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cni-binary-copy" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969274    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="10a6a241-8eef-4bf1-b609-dd71d2042646" volumeName="kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-trusted-ca" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969309    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c" volumeName="kubernetes.io/configmap/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-iptables-alerter-script" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969319    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="70c6fee2-4568-4dfc-85ff-cfd1fc1c8262" volumeName="kubernetes.io/secret/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969328    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80c620b9-0db9-47a5-a843-99d81db2ef95" volumeName="kubernetes.io/secret/80c620b9-0db9-47a5-a843-99d81db2ef95-signing-key" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969336    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88031944-e289-40ee-b002-884805e6bec6" volumeName="kubernetes.io/empty-dir/88031944-e289-40ee-b002-884805e6bec6-data-volume" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969343    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ea83f1f-61e7-4236-a5e7-08c079de313b" volumeName="kubernetes.io/empty-dir/8ea83f1f-61e7-4236-a5e7-08c079de313b-snapshots" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969351    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ea83f1f-61e7-4236-a5e7-08c079de313b" volumeName="kubernetes.io/projected/8ea83f1f-61e7-4236-a5e7-08c079de313b-kube-api-access-8mbh7" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969361    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12b0e63f-73f7-429a-879d-617267cc5f36" volumeName="kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-stats-auth" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969373    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ba6ecd5-1d02-4433-b245-1c957827467e" volumeName="kubernetes.io/secret/7ba6ecd5-1d02-4433-b245-1c957827467e-serving-cert" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969397    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8322007d-27a3-43f8-b6d9-0d183f5e433f" volumeName="kubernetes.io/projected/8322007d-27a3-43f8-b6d9-0d183f5e433f-kube-api-access-wv4bv" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969405    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="836fc8fa-ebbb-4836-b453-2b9be6db8452" volumeName="kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-image-registry-private-configuration" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969435    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b6a6ef43-27ed-4be0-becd-e5f455be56a8" volumeName="kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969442    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0caf85ea-1bec-4670-a2e1-3cafd0e5a587" volumeName="kubernetes.io/configmap/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-trusted-ca" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969453    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="10d51151-30e6-4c36-a13b-5af9c5ba56e8" volumeName="kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969465    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="580c347a-163e-4e05-a1e4-497c10edb3ed" volumeName="kubernetes.io/configmap/580c347a-163e-4e05-a1e4-497c10edb3ed-cni-binary-copy" seLinuxMountContext=""
Nov 03 17:16:39.969445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969474    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="836fc8fa-ebbb-4836-b453-2b9be6db8452" volumeName="kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-installation-pull-secrets" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969482    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ea83f1f-61e7-4236-a5e7-08c079de313b" volumeName="kubernetes.io/empty-dir/8ea83f1f-61e7-4236-a5e7-08c079de313b-tmp" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969501    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ef0f942-8c3c-43c9-bc45-a40b69188935" volumeName="kubernetes.io/secret/2ef0f942-8c3c-43c9-bc45-a40b69188935-cert" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969519    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="579ad6b2-cca6-4950-b2f2-1604e8757f1a" volumeName="kubernetes.io/projected/579ad6b2-cca6-4950-b2f2-1604e8757f1a-kube-api-access-w7zf6" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969528    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="70c6fee2-4568-4dfc-85ff-cfd1fc1c8262" volumeName="kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-env-overrides" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969542    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80c620b9-0db9-47a5-a843-99d81db2ef95" volumeName="kubernetes.io/projected/80c620b9-0db9-47a5-a843-99d81db2ef95-kube-api-access-2f2jx" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969590    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d47d6f3-b42c-4027-863e-e148d6d22726" volumeName="kubernetes.io/configmap/9d47d6f3-b42c-4027-863e-e148d6d22726-serviceca" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969603    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d47d6f3-b42c-4027-863e-e148d6d22726" volumeName="kubernetes.io/projected/9d47d6f3-b42c-4027-863e-e148d6d22726-kube-api-access-2gw8x" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969615    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e8ba695c-5928-49ec-9040-3e5171c81b4b" volumeName="kubernetes.io/projected/e8ba695c-5928-49ec-9040-3e5171c81b4b-kube-api-access-n2m6j" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969639    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="70c6fee2-4568-4dfc-85ff-cfd1fc1c8262" volumeName="kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovnkube-config" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969663    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ea83f1f-61e7-4236-a5e7-08c079de313b" volumeName="kubernetes.io/configmap/8ea83f1f-61e7-4236-a5e7-08c079de313b-service-ca-bundle" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969675    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98bb71f4-49c7-4216-b61e-f14b7b3a6368" volumeName="kubernetes.io/projected/98bb71f4-49c7-4216-b61e-f14b7b3a6368-kube-api-access-lnfnt" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969687    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4451ce6-8729-4567-9e85-d5eba0db6139" volumeName="kubernetes.io/projected/e4451ce6-8729-4567-9e85-d5eba0db6139-kube-api-access-mp727" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969701    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f11f9269-8c8d-43da-a7f6-c766c17793c4" volumeName="kubernetes.io/configmap/f11f9269-8c8d-43da-a7f6-c766c17793c4-konnectivity-ca" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969720    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26f7336a-a2b6-4f80-b417-a9a5d1648d69" volumeName="kubernetes.io/projected/26f7336a-a2b6-4f80-b417-a9a5d1648d69-kube-api-access-b6dwh" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969745    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="32072064-dcf7-4c58-a5ef-47eeadb245e5" volumeName="kubernetes.io/secret/32072064-dcf7-4c58-a5ef-47eeadb245e5-serving-cert" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969755    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6e6d73d7-6236-4642-9b4c-74940e54057a" volumeName="kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-service-ca-bundle" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969766    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80c620b9-0db9-47a5-a843-99d81db2ef95" volumeName="kubernetes.io/configmap/80c620b9-0db9-47a5-a843-99d81db2ef95-signing-cabundle" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969785    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="836fc8fa-ebbb-4836-b453-2b9be6db8452" volumeName="kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-certificates" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969807    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3" volumeName="kubernetes.io/configmap/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-nginx-conf" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969822    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="10a6a241-8eef-4bf1-b609-dd71d2042646" volumeName="kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-certificates" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969842    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="10a6a241-8eef-4bf1-b609-dd71d2042646" volumeName="kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-bound-sa-token" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969870    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="10a6a241-8eef-4bf1-b609-dd71d2042646" volumeName="kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-image-registry-private-configuration" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969879    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="579ad6b2-cca6-4950-b2f2-1604e8757f1a" volumeName="kubernetes.io/empty-dir/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-tuned" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969903    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6e6d73d7-6236-4642-9b4c-74940e54057a" volumeName="kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-trusted-ca-bundle" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969912    5021 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="836fc8fa-ebbb-4836-b453-2b9be6db8452" volumeName="kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-kube-api-access-2zkk6" seLinuxMountContext=""
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969919    5021 reconstruct.go:97] "Volume reconstruction finished"
Nov 03 17:16:39.971398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.969924    5021 reconciler.go:29] "Reconciler: start to sync state"
Nov 03 17:16:39.973071 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.973053    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/1.log"
Nov 03 17:16:39.975045 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.975028    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/1.log"
Nov 03 17:16:39.993797 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.993745    5021 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 03 17:16:39.994984 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.994959    5021 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 03 17:16:39.994984 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.994981    5021 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 03 17:16:39.995143 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:39.994998    5021 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 03 17:16:39.995143 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:39.995043    5021 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 03 17:16:40.026483 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.026443    5021 generic.go:356] "Generic (PLEG): container finished" podID="b6a6ef43-27ed-4be0-becd-e5f455be56a8" containerID="d3a66e5a570a70e310f5c10d8adceeac5817c27027bf44f432431d820444f891" exitCode=0
Nov 03 17:16:40.026483 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.026478    5021 generic.go:356] "Generic (PLEG): container finished" podID="b6a6ef43-27ed-4be0-becd-e5f455be56a8" containerID="2270a1d452911443f094932d7be10778ec5ad645e942f6287535d7d1b327bfd5" exitCode=0
Nov 03 17:16:40.026483 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.026485    5021 generic.go:356] "Generic (PLEG): container finished" podID="b6a6ef43-27ed-4be0-becd-e5f455be56a8" containerID="4c6bf7e3405ff274321334c30aed98204493153358fbcf83ad2fc75bbaa051e8" exitCode=0
Nov 03 17:16:40.026483 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.026491    5021 generic.go:356] "Generic (PLEG): container finished" podID="b6a6ef43-27ed-4be0-becd-e5f455be56a8" containerID="53287564bda149b40cfe5c320cf0c7900e6b497d09840658c7893ba26972282a" exitCode=0
Nov 03 17:16:40.026733 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.026498    5021 generic.go:356] "Generic (PLEG): container finished" podID="b6a6ef43-27ed-4be0-becd-e5f455be56a8" containerID="d82159e3176b876b991454af22aa3afa372415397f4d4c1512c895353065cb71" exitCode=0
Nov 03 17:16:40.026733 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.026503    5021 generic.go:356] "Generic (PLEG): container finished" podID="b6a6ef43-27ed-4be0-becd-e5f455be56a8" containerID="ae0d5dc610763eae380e6bb0b8861a6097f36892d99353badd200c3540f4c2f0" exitCode=0
Nov 03 17:16:40.036359 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.036333    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/1.log"
Nov 03 17:16:40.036480 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.036368    5021 generic.go:356] "Generic (PLEG): container finished" podID="0caf85ea-1bec-4670-a2e1-3cafd0e5a587" containerID="397e426a106fa9ee5cc7b4d7b54c4318d67e32e35d40b6133c43ee2df4a50d14" exitCode=255
Nov 03 17:16:40.043726 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.043698    5021 generic.go:356] "Generic (PLEG): container finished" podID="20468b9466c50fbce4ed8671ac1a9d57" containerID="4754ea88c40141af85d18344b8c6e5f06d5b4d5ed063250f7e813957654c4564" exitCode=0
Nov 03 17:16:40.065839 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:40.065813    5021 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:16:40.070320 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.070300    5021 manager.go:324] Recovery completed
Nov 03 17:16:40.088649 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.088628    5021 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 17:16:40.089814 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.089797    5021 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 17:16:40.089911 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.089830    5021 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 17:16:40.089911 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.089845    5021 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 17:16:40.092523 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.092503    5021 cpu_manager.go:226] "Starting" policy="none"
Nov 03 17:16:40.092523 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.092518    5021 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 03 17:16:40.092622 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.092529    5021 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 17:16:40.092622 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.092538    5021 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 03 17:16:40.092749 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.092735    5021 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 03 17:16:40.092790 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.092749    5021 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 03 17:16:40.092790 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.092767    5021 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 03 17:16:40.092790 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.092772    5021 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 03 17:16:40.092790 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.092777    5021 policy_none.go:50] "Start"
Nov 03 17:16:40.092790 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.092785    5021 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 03 17:16:40.092938 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.092794    5021 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 03 17:16:40.092967 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.092934    5021 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 03 17:16:40.092967 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.092944    5021 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 03 17:16:40.092967 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.092950    5021 policy_none.go:44] "Start"
Nov 03 17:16:40.093495 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.093477    5021 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 17:16:40.093569 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.093503    5021 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 17:16:40.093569 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.093514    5021 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 17:16:40.095170 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:40.095152    5021 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Nov 03 17:16:40.097355 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.097330    5021 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 03 17:16:40.100680 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.100665    5021 manager.go:341] "Starting Device Plugin manager"
Nov 03 17:16:40.100766 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:40.100693    5021 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 03 17:16:40.100766 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.100705    5021 server.go:87] "Starting device plugin registration server"
Nov 03 17:16:40.100907 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.100892    5021 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 03 17:16:40.100974 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.100908    5021 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 03 17:16:40.101031 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.100982    5021 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 03 17:16:40.101129 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.101097    5021 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 03 17:16:40.101175 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.101136    5021 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 03 17:16:40.101175 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.101143    5021 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 03 17:16:40.101770 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.101195    5021 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T17:16:40.101126534Z","UUID":"210ea58e-7d63-4020-8649-6b2d1b656f3b","Handler":null,"Name":"","Endpoint":""}
Nov 03 17:16:40.102548 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:40.102528    5021 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 03 17:16:40.102628 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:40.102566    5021 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-219.us-west-2.compute.internal\" not found"
Nov 03 17:16:40.103167 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.103133    5021 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 03 17:16:40.103291 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.103183    5021 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 03 17:16:40.105616 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.105599    5021 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 03 17:16:40.154064 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.153982    5021 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 17:16:40.154064 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.154027    5021 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 17:16:40.154344 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.154327    5021 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 17:16:40.154344 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.154337    5021 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 17:16:40.201730 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.201699    5021 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 17:16:40.202920 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.202897    5021 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 03 17:16:40.203007 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.202934    5021 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 03 17:16:40.203007 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.202946    5021 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-219.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 03 17:16:40.203007 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.202990    5021 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:16:40.296125 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.296058    5021 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal"]
Nov 03 17:16:40.297761 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.297701    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal" event={"ID":"eb1cf377fcbbbe2547aa17b485064a9c","Type":"ContainerStarted","Data":"8597bfb71cff8c7e38626d71eb18aaf5e4e2ac261c6d02214da040f6f2a9e215"}
Nov 03 17:16:40.297915 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.297779    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal" event={"ID":"eb1cf377fcbbbe2547aa17b485064a9c","Type":"ContainerStarted","Data":"61a3bedb1f58b0329d222bea87e6fb944025649d8d25e0d09207bdd14ce73cfa"}
Nov 03 17:16:40.297915 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.297847    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal" event={"ID":"20468b9466c50fbce4ed8671ac1a9d57","Type":"ContainerStarted","Data":"991b11005161eaaac15ea9344e27eb8c4c6a2367f149699d1e307abedb32e4d0"}
Nov 03 17:16:40.297915 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.297868    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal" event={"ID":"20468b9466c50fbce4ed8671ac1a9d57","Type":"ContainerDied","Data":"4754ea88c40141af85d18344b8c6e5f06d5b4d5ed063250f7e813957654c4564"}
Nov 03 17:16:40.297915 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.297893    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal" event={"ID":"20468b9466c50fbce4ed8671ac1a9d57","Type":"ContainerStarted","Data":"2fb9254e65b9145bb5a84caa9b1bb152abbe58598b653795e58cae8fb7d2685d"}
Nov 03 17:16:40.298253 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.298219    5021 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:16:40.299092 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.299075    5021 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:16:40.317876 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.317849    5021 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:16:40.317960 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.317924    5021 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:16:40.353176 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.353150    5021 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 17:16:40.353355 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:40.353200    5021 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:16:40.366348 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.366321    5021 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 17:16:40.366454 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:40.366369    5021 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:16:40.406537 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.406447    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20468b9466c50fbce4ed8671ac1a9d57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"20468b9466c50fbce4ed8671ac1a9d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:16:40.406537 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.406486    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20468b9466c50fbce4ed8671ac1a9d57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"20468b9466c50fbce4ed8671ac1a9d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:16:40.406537 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.406516    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb1cf377fcbbbe2547aa17b485064a9c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"eb1cf377fcbbbe2547aa17b485064a9c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:16:40.508063 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.506712    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20468b9466c50fbce4ed8671ac1a9d57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"20468b9466c50fbce4ed8671ac1a9d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:16:40.508063 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.506739    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20468b9466c50fbce4ed8671ac1a9d57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"20468b9466c50fbce4ed8671ac1a9d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:16:40.508063 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.506826    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20468b9466c50fbce4ed8671ac1a9d57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"20468b9466c50fbce4ed8671ac1a9d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:16:40.508063 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.506869    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb1cf377fcbbbe2547aa17b485064a9c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"eb1cf377fcbbbe2547aa17b485064a9c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:16:40.508063 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.506918    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20468b9466c50fbce4ed8671ac1a9d57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"20468b9466c50fbce4ed8671ac1a9d57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:16:40.508063 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.506923    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb1cf377fcbbbe2547aa17b485064a9c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal\" (UID: \"eb1cf377fcbbbe2547aa17b485064a9c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal"
Nov 03 17:16:40.897168 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:40.897135    5021 apiserver.go:52] "Watching apiserver"
Nov 03 17:16:41.050339 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.050300    5021 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 03 17:16:41.051022 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.050990    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-8gpj4","kube-system/konnectivity-agent-jjqzh","openshift-kube-storage-version-migrator/migrator-66df5d496b-fb8hc","openshift-insights/insights-operator-7c4986d449-vsdc5","openshift-multus/multus-6dsbk","openshift-ingress-canary/ingress-canary-gstrl","kube-system/kas-connection-checker-685895c7c9-8dw9x","openshift-insights/insights-runtime-extractor-9lj8v","openshift-dns/node-resolver-jfpzv","openshift-console-operator/console-operator-7cd56b8dbc-6fwkq","openshift-network-diagnostics/network-check-target-s7n7v","openshift-network-diagnostics/network-check-source-6f78d59f99-lb8nj","openshift-multus/multus-additional-cni-plugins-sxmdm","openshift-kube-storage-version-migrator/migrator-66df5d496b-nbnrp","kube-system/global-pull-secret-syncer-cfrm8","kube-system/kas-connection-checker-685895c7c9-kpfdx","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp","openshift-cluster-node-tuning-operator/tuned-cqgxc","openshift-ingress/router-default-678bd9c4d9-wrhq6","openshift-service-ca/service-ca-5fffc97bdf-sch8k","kube-system/kas-connection-checker-685895c7c9-vgvw9","openshift-ovn-kubernetes/ovnkube-node-tgppb","openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt","openshift-dns/dns-default-j4bd8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-219.us-west-2.compute.internal","openshift-image-registry/image-registry-5599885c48-cn2ff","kube-system/kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal","openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-thckz","openshift-multus/network-metrics-daemon-pvnlt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k","openshift-image-registry/node-ca-5695n","openshift-network-console/networking-console-plugin-86c478bb88-jmrx4","openshift-image-registry/image-registry-7c98dd6d65-rjtsq","openshift-insights/periodic-gathering-vjvw2-sht76","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"]
Nov 03 17:16:41.052391 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.052368    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:41.054138 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.054115    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.054847 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.054819    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:41.055217 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.055199    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:41.055942 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.055925    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:41.062990 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.062967    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:41.065551 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.065524    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.066136 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.066116    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:41.069201 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.069181    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:41.101674 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.101649    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.101780 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.101649    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.101780 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.101773    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Nov 03 17:16:41.103411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.103391    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Nov 03 17:16:41.103851 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.103836    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Nov 03 17:16:41.104087 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.104075    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Nov 03 17:16:41.104282 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.104270    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Nov 03 17:16:41.104379 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.104365    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Nov 03 17:16:41.104561 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.104550    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Nov 03 17:16:41.104600 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.104585    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Nov 03 17:16:41.104996 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.104974    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Nov 03 17:16:41.106657 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.106643    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Nov 03 17:16:41.106710 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.106668    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.106710 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.106672    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Nov 03 17:16:41.106710 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.106704    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Nov 03 17:16:41.106822 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.106741    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.106822 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.106790    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Nov 03 17:16:41.108176 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.108160    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Nov 03 17:16:41.108250 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.108204    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.108461 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.108443    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.108461 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.108458    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.108556 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.108496    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 03 17:16:41.108556 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.108501    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.108556 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.108513    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.108556 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.108513    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.108556 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.108541    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.108816 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.108801    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.108864 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.108838    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Nov 03 17:16:41.108864 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.108855    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.108932 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.108891    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.108932 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.108903    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.109057 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109042    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Nov 03 17:16:41.109099 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109043    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.109343 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109325    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-ovn\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.109385 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109358    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sb99\" (UniqueName: \"kubernetes.io/projected/7ba6ecd5-1d02-4433-b245-1c957827467e-kube-api-access-2sb99\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-btzt2\" (UID: \"7ba6ecd5-1d02-4433-b245-1c957827467e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"
Nov 03 17:16:41.109385 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109376    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6dwh\" (UniqueName: \"kubernetes.io/projected/26f7336a-a2b6-4f80-b417-a9a5d1648d69-kube-api-access-b6dwh\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:41.109481 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109399    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-slash\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.109481 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109445    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovnkube-config\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.109605 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109587    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f11f9269-8c8d-43da-a7f6-c766c17793c4-konnectivity-ca\") pod \"konnectivity-agent-jjqzh\" (UID: \"f11f9269-8c8d-43da-a7f6-c766c17793c4\") " pod="kube-system/konnectivity-agent-jjqzh"
Nov 03 17:16:41.109641 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109613    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-config\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:41.109687 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109636    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gw8x\" (UniqueName: \"kubernetes.io/projected/9d47d6f3-b42c-4027-863e-e148d6d22726-kube-api-access-2gw8x\") pod \"node-ca-5695n\" (UID: \"9d47d6f3-b42c-4027-863e-e148d6d22726\") " pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:16:41.109687 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109660    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2f2e4d96-73c8-4a18-b4f7-97387ed44645-config-volume\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:41.109796 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109782    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-system-cni-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.109855 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109807    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-bound-sa-token\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.109855 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109820    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-config\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:41.109855 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109824    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-tuned\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.109971 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109866    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-run-ovn-kubernetes\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.109971 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109882    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-conf-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.109971 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109898    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp26q\" (UniqueName: \"kubernetes.io/projected/951f5784-32a9-40a3-b503-33249c04d5fc-kube-api-access-jp26q\") pod \"kas-connection-checker-685895c7c9-vgvw9\" (UID: \"951f5784-32a9-40a3-b503-33249c04d5fc\") " pod="kube-system/kas-connection-checker-685895c7c9-vgvw9"
Nov 03 17:16:41.109971 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109914    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-installation-pull-secrets\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.109971 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109924    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-tuned\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.109971 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.109932    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:41.110271 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110055    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqqmv\" (UniqueName: \"kubernetes.io/projected/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-kube-api-access-pqqmv\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:41.110271 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110088    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-nginx-conf\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:41.110271 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110115    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-certificates\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.110271 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110136    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmd2h\" (UniqueName: \"kubernetes.io/projected/69f0b08a-743a-441e-815c-015bcd833058-kube-api-access-vmd2h\") pod \"network-check-source-6f78d59f99-lb8nj\" (UID: \"69f0b08a-743a-441e-815c-015bcd833058\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lb8nj"
Nov 03 17:16:41.110271 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110152    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-serving-cert\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:41.110271 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110160    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-installation-pull-secrets\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.110271 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110172    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-multus-certs\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.110271 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110196    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32072064-dcf7-4c58-a5ef-47eeadb245e5-serving-cert\") pod \"service-ca-operator-544d749c8c-kscd2\" (UID: \"32072064-dcf7-4c58-a5ef-47eeadb245e5\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"
Nov 03 17:16:41.110271 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110252    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:41.110652 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110283    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.110652 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110338    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-trusted-ca\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:41.110652 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110335    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-serving-cert\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:41.110652 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110355    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:16:41.110652 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110398    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10d51151-30e6-4c36-a13b-5af9c5ba56e8-kubelet-config\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:41.110652 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110400    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32072064-dcf7-4c58-a5ef-47eeadb245e5-serving-cert\") pod \"service-ca-operator-544d749c8c-kscd2\" (UID: \"32072064-dcf7-4c58-a5ef-47eeadb245e5\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"
Nov 03 17:16:41.110652 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110420    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:41.110652 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110442    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2m6j\" (UniqueName: \"kubernetes.io/projected/e8ba695c-5928-49ec-9040-3e5171c81b4b-kube-api-access-n2m6j\") pod \"node-resolver-jfpzv\" (UID: \"e8ba695c-5928-49ec-9040-3e5171c81b4b\") " pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:16:41.110652 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110476    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-log-socket\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.110652 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110495    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-etc-selinux\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.110652 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110510    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysconfig\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.110652 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110528    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysctl-d\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.110652 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110565    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ea83f1f-61e7-4236-a5e7-08c079de313b-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:41.110652 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110613    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-systemd\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.111175 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110669    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-system-cni-dir\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:16:41.111175 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110693    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-netns\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.111175 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110727    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8ba695c-5928-49ec-9040-3e5171c81b4b-hosts-file\") pod \"node-resolver-jfpzv\" (UID: \"e8ba695c-5928-49ec-9040-3e5171c81b4b\") " pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:16:41.111175 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110769    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:16:41.111175 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110822    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv4bv\" (UniqueName: \"kubernetes.io/projected/8322007d-27a3-43f8-b6d9-0d183f5e433f-kube-api-access-wv4bv\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.111175 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110843    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:41.111175 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110863    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-node-log\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.111175 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110880    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87dpc\" (UniqueName: \"kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc\") pod \"network-check-target-s7n7v\" (UID: \"34d75159-9865-405a-88fe-5cf738813dde\") " pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:41.111175 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110900    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.111175 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110935    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6q9p\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-kube-api-access-h6q9p\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.111175 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.110996    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-modprobe-d\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.111175 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111084    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/579ad6b2-cca6-4950-b2f2-1604e8757f1a-tmp\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.111175 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111133    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-var-lib-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.111175 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111168    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/579ad6b2-cca6-4950-b2f2-1604e8757f1a-tmp\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.111175 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111169    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xhtw\" (UniqueName: \"kubernetes.io/projected/2f2e4d96-73c8-4a18-b4f7-97387ed44645-kube-api-access-4xhtw\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:41.111789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111205    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-socket-dir-parent\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.111789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111239    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhp4d\" (UniqueName: \"kubernetes.io/projected/cf675d26-93c5-4a45-90db-7f95e260ac30-kube-api-access-mhp4d\") pod \"kas-connection-checker-685895c7c9-8dw9x\" (UID: \"cf675d26-93c5-4a45-90db-7f95e260ac30\") " pod="kube-system/kas-connection-checker-685895c7c9-8dw9x"
Nov 03 17:16:41.111789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111281    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-systemd-units\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.111789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111309    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-cni-multus\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.111789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111337    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-daemon-config\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.111789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111369    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-image-registry-private-configuration\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.111789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111393    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-cni-bin\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.111789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111434    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w6wx\" (UniqueName: \"kubernetes.io/projected/749ecc85-b28a-4ecd-aaf0-27de9c332713-kube-api-access-5w6wx\") pod \"kas-connection-checker-685895c7c9-kpfdx\" (UID: \"749ecc85-b28a-4ecd-aaf0-27de9c332713\") " pod="kube-system/kas-connection-checker-685895c7c9-kpfdx"
Nov 03 17:16:41.111789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111451    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-cnibin\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.111789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111467    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdnwh\" (UniqueName: \"kubernetes.io/projected/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-kube-api-access-kdnwh\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:41.111789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111488    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e4451ce6-8729-4567-9e85-d5eba0db6139-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:41.111789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111524    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:41.111789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111530    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-image-registry-private-configuration\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.111789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111600    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:41.111789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111645    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ba695c-5928-49ec-9040-3e5171c81b4b-tmp-dir\") pod \"node-resolver-jfpzv\" (UID: \"e8ba695c-5928-49ec-9040-3e5171c81b4b\") " pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:16:41.111789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111695    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-bound-sa-token\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.111789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111752    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ba695c-5928-49ec-9040-3e5171c81b4b-tmp-dir\") pod \"node-resolver-jfpzv\" (UID: \"e8ba695c-5928-49ec-9040-3e5171c81b4b\") " pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:16:41.112433 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111805    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zkk6\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-kube-api-access-2zkk6\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.112433 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111915    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:41.112433 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.111992    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-stats-auth\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:41.112433 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112013    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-cni-netd\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.112433 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112116    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10d51151-30e6-4c36-a13b-5af9c5ba56e8-dbus\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:41.112433 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112162    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10a6a241-8eef-4bf1-b609-dd71d2042646-ca-trust-extracted\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.112433 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112207    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-stats-auth\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:41.112433 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112220    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cnibin\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:16:41.112433 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112288    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10a6a241-8eef-4bf1-b609-dd71d2042646-ca-trust-extracted\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.112433 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112332    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ba6ecd5-1d02-4433-b245-1c957827467e-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-btzt2\" (UID: \"7ba6ecd5-1d02-4433-b245-1c957827467e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"
Nov 03 17:16:41.112433 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112387    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysctl-conf\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.112819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112458    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-run-netns\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.112819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112491    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ba6ecd5-1d02-4433-b245-1c957827467e-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-btzt2\" (UID: \"7ba6ecd5-1d02-4433-b245-1c957827467e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"
Nov 03 17:16:41.112819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112493    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mmd9\" (UniqueName: \"kubernetes.io/projected/a43a3fa1-f14d-4abc-95bb-1a1f21f25b01-kube-api-access-4mmd9\") pod \"volume-data-source-validator-58c9f5f46d-thckz\" (UID: \"a43a3fa1-f14d-4abc-95bb-1a1f21f25b01\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-thckz"
Nov 03 17:16:41.112819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112546    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-image-registry-private-configuration\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.112819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112633    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f11f9269-8c8d-43da-a7f6-c766c17793c4-agent-certs\") pod \"konnectivity-agent-jjqzh\" (UID: \"f11f9269-8c8d-43da-a7f6-c766c17793c4\") " pod="kube-system/konnectivity-agent-jjqzh"
Nov 03 17:16:41.112819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112728    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2e4d96-73c8-4a18-b4f7-97387ed44645-tmp-dir\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:41.112819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112757    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-image-registry-private-configuration\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.112819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112805    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:16:41.113077 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112846    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-systemd\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.113077 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112854    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2e4d96-73c8-4a18-b4f7-97387ed44645-tmp-dir\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:41.113077 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112885    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d47d6f3-b42c-4027-863e-e148d6d22726-serviceca\") pod \"node-ca-5695n\" (UID: \"9d47d6f3-b42c-4027-863e-e148d6d22726\") " pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:16:41.113077 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112923    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:41.113077 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112961    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-run\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.113077 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.112982    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-lib-modules\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.113077 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113026    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mbh7\" (UniqueName: \"kubernetes.io/projected/8ea83f1f-61e7-4236-a5e7-08c079de313b-kube-api-access-8mbh7\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:41.113077 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113065    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d47d6f3-b42c-4027-863e-e148d6d22726-host\") pod \"node-ca-5695n\" (UID: \"9d47d6f3-b42c-4027-863e-e148d6d22726\") " pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:16:41.113497 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113110    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-cni-bin\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.113497 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113139    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-socket-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.113497 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113168    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8ea83f1f-61e7-4236-a5e7-08c079de313b-snapshots\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:41.113497 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113260    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8ea83f1f-61e7-4236-a5e7-08c079de313b-snapshots\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:41.113497 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113318    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovn-node-metrics-cert\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.113497 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113348    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8p68\" (UniqueName: \"kubernetes.io/projected/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-kube-api-access-j8p68\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.113497 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113377    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-hostroot\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.113497 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113406    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-etc-kubernetes\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.113497 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113441    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/836fc8fa-ebbb-4836-b453-2b9be6db8452-ca-trust-extracted\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.113497 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113480    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-host-slash\") pod \"iptables-alerter-8gpj4\" (UID: \"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c\") " pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:16:41.113497 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113498    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.113902 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113516    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlrxg\" (UniqueName: \"kubernetes.io/projected/12b0e63f-73f7-429a-879d-617267cc5f36-kube-api-access-nlrxg\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:41.113902 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113540    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-trusted-ca\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.113902 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113575    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/836fc8fa-ebbb-4836-b453-2b9be6db8452-ca-trust-extracted\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.113902 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113687    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-trusted-ca\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.113902 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113716    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ea83f1f-61e7-4236-a5e7-08c079de313b-serving-cert\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:41.113902 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113745    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-kubelet\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.113902 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113772    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ba6ecd5-1d02-4433-b245-1c957827467e-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-btzt2\" (UID: \"7ba6ecd5-1d02-4433-b245-1c957827467e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"
Nov 03 17:16:41.113902 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113799    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7zf6\" (UniqueName: \"kubernetes.io/projected/579ad6b2-cca6-4950-b2f2-1604e8757f1a-kube-api-access-w7zf6\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.113902 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113830    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.113902 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113882    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ea83f1f-61e7-4236-a5e7-08c079de313b-serving-cert\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:41.113902 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113895    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-registration-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.114285 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113937    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-k8s-cni-cncf-io\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.114285 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113976    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32072064-dcf7-4c58-a5ef-47eeadb245e5-config\") pod \"service-ca-operator-544d749c8c-kscd2\" (UID: \"32072064-dcf7-4c58-a5ef-47eeadb245e5\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"
Nov 03 17:16:41.114285 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.113980    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ba6ecd5-1d02-4433-b245-1c957827467e-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-btzt2\" (UID: \"7ba6ecd5-1d02-4433-b245-1c957827467e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"
Nov 03 17:16:41.114285 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114025    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-installation-pull-secrets\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.114285 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114097    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-sys\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.114285 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114125    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.114285 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114154    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32072064-dcf7-4c58-a5ef-47eeadb245e5-config\") pod \"service-ca-operator-544d749c8c-kscd2\" (UID: \"32072064-dcf7-4c58-a5ef-47eeadb245e5\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"
Nov 03 17:16:41.114285 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114161    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:16:41.114285 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114244    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-cni-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.114285 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114259    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-installation-pull-secrets\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.114285 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114266    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-var-lib-kubelet\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.114711 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114297    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-kubelet\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.114711 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114335    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp727\" (UniqueName: \"kubernetes.io/projected/e4451ce6-8729-4567-9e85-d5eba0db6139-kube-api-access-mp727\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:41.114711 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114374    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-iptables-alerter-script\") pod \"iptables-alerter-8gpj4\" (UID: \"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c\") " pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:16:41.114711 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114445    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkwbc\" (UniqueName: \"kubernetes.io/projected/580c347a-163e-4e05-a1e4-497c10edb3ed-kube-api-access-qkwbc\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.114711 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114505    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-sys-fs\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.114711 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114525    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ea83f1f-61e7-4236-a5e7-08c079de313b-tmp\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:41.114711 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114541    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-default-certificate\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:41.114711 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114557    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-env-overrides\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.114711 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114573    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-device-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.114711 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114600    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:41.114711 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114624    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ea83f1f-61e7-4236-a5e7-08c079de313b-tmp\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:41.114711 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114629    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ea83f1f-61e7-4236-a5e7-08c079de313b-service-ca-bundle\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:41.114711 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114655    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovnkube-script-lib\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.114711 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114683    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kjm9\" (UniqueName: \"kubernetes.io/projected/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-kube-api-access-8kjm9\") pod \"iptables-alerter-8gpj4\" (UID: \"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c\") " pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:16:41.115200 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114790    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ea83f1f-61e7-4236-a5e7-08c079de313b-service-ca-bundle\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:41.115200 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114798    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27s7f\" (UniqueName: \"kubernetes.io/projected/32072064-dcf7-4c58-a5ef-47eeadb245e5-kube-api-access-27s7f\") pod \"service-ca-operator-544d749c8c-kscd2\" (UID: \"32072064-dcf7-4c58-a5ef-47eeadb245e5\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"
Nov 03 17:16:41.115200 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114818    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:41.115200 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114816    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-default-certificate\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:41.115200 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114839    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzdj5\" (UniqueName: \"kubernetes.io/projected/b6a6ef43-27ed-4be0-becd-e5f455be56a8-kube-api-access-xzdj5\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:16:41.115200 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114866    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/580c347a-163e-4e05-a1e4-497c10edb3ed-cni-binary-copy\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.115200 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114898    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-certificates\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.115200 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114925    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-kubernetes\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.115200 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114950    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-host\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.115200 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.114973    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-etc-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.154555 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.154489    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Nov 03 17:16:41.158685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.154969    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 03 17:16:41.158685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.156498    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 03 17:16:41.158685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.156647    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.158685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.157394    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 03 17:16:41.158685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.157987    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Nov 03 17:16:41.158685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158091    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.158685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158203    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.158685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158340    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.158685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158469    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.158685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158510    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 03 17:16:41.158685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158516    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 03 17:16:41.158685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158538    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.158685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158566    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 03 17:16:41.158685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158607    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.158685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158537    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.158685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158643    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158738    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158795    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158797    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158826    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158799    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158887    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158936    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.158946    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.159054    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.159195    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.159291    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.159323    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.159392    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.159404    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.159409    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.159425    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.159474    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.159555    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.159576    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.159612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.159578    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 03 17:16:41.160398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.159738    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.160398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.159778    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 03 17:16:41.160398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.160339    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Nov 03 17:16:41.160398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.160349    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 03 17:16:41.160398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.160353    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovnkube-config\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.160398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.160390    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2f2e4d96-73c8-4a18-b4f7-97387ed44645-config-volume\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:41.160660 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.160414    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-certificates\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.160660 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.160527    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-nginx-conf\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:41.160660 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.160644    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-trusted-ca\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:41.160812 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.160681    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:16:41.160812 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.160689    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f11f9269-8c8d-43da-a7f6-c766c17793c4-konnectivity-ca\") pod \"konnectivity-agent-jjqzh\" (UID: \"f11f9269-8c8d-43da-a7f6-c766c17793c4\") " pod="kube-system/konnectivity-agent-jjqzh"
Nov 03 17:16:41.160968 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.160943    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ea83f1f-61e7-4236-a5e7-08c079de313b-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:41.161023 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.160984    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 03 17:16:41.161089 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.161073    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:16:41.161689 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.161669    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-daemon-config\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.161881 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.161862    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e4451ce6-8729-4567-9e85-d5eba0db6139-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:41.163303 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.163287    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d47d6f3-b42c-4027-863e-e148d6d22726-serviceca\") pod \"node-ca-5695n\" (UID: \"9d47d6f3-b42c-4027-863e-e148d6d22726\") " pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:16:41.164403 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.164387    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b6a6ef43-27ed-4be0-becd-e5f455be56a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:16:41.164569 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.164546    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-trusted-ca\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.164741 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.164727    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-trusted-ca\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.164777 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.164753    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-iptables-alerter-script\") pod \"iptables-alerter-8gpj4\" (UID: \"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c\") " pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:16:41.164847 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.164834    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-env-overrides\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.164912 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.164898    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovnkube-script-lib\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.165819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.165802    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-certificates\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.165865 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.165805    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/580c347a-163e-4e05-a1e4-497c10edb3ed-cni-binary-copy\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.166288 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.166275    5021 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 03 17:16:41.167064 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.167047    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gw8x\" (UniqueName: \"kubernetes.io/projected/9d47d6f3-b42c-4027-863e-e148d6d22726-kube-api-access-2gw8x\") pod \"node-ca-5695n\" (UID: \"9d47d6f3-b42c-4027-863e-e148d6d22726\") " pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:16:41.167368 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.167352    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp26q\" (UniqueName: \"kubernetes.io/projected/951f5784-32a9-40a3-b503-33249c04d5fc-kube-api-access-jp26q\") pod \"kas-connection-checker-685895c7c9-vgvw9\" (UID: \"951f5784-32a9-40a3-b503-33249c04d5fc\") " pod="kube-system/kas-connection-checker-685895c7c9-vgvw9"
Nov 03 17:16:41.167572 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.167556    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sb99\" (UniqueName: \"kubernetes.io/projected/7ba6ecd5-1d02-4433-b245-1c957827467e-kube-api-access-2sb99\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-btzt2\" (UID: \"7ba6ecd5-1d02-4433-b245-1c957827467e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2"
Nov 03 17:16:41.167804 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.167789    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-bound-sa-token\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.168011 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.167991    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqqmv\" (UniqueName: \"kubernetes.io/projected/0caf85ea-1bec-4670-a2e1-3cafd0e5a587-kube-api-access-pqqmv\") pod \"console-operator-7cd56b8dbc-6fwkq\" (UID: \"0caf85ea-1bec-4670-a2e1-3cafd0e5a587\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:41.168042 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.168006    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmd2h\" (UniqueName: \"kubernetes.io/projected/69f0b08a-743a-441e-815c-015bcd833058-kube-api-access-vmd2h\") pod \"network-check-source-6f78d59f99-lb8nj\" (UID: \"69f0b08a-743a-441e-815c-015bcd833058\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lb8nj"
Nov 03 17:16:41.174599 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.174578    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6dwh\" (UniqueName: \"kubernetes.io/projected/26f7336a-a2b6-4f80-b417-a9a5d1648d69-kube-api-access-b6dwh\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:41.174641 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.174630    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2m6j\" (UniqueName: \"kubernetes.io/projected/e8ba695c-5928-49ec-9040-3e5171c81b4b-kube-api-access-n2m6j\") pod \"node-resolver-jfpzv\" (UID: \"e8ba695c-5928-49ec-9040-3e5171c81b4b\") " pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:16:41.175426 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.175410    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv4bv\" (UniqueName: \"kubernetes.io/projected/8322007d-27a3-43f8-b6d9-0d183f5e433f-kube-api-access-wv4bv\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.175949 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.175935    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87dpc\" (UniqueName: \"kubernetes.io/projected/34d75159-9865-405a-88fe-5cf738813dde-kube-api-access-87dpc\") pod \"network-check-target-s7n7v\" (UID: \"34d75159-9865-405a-88fe-5cf738813dde\") " pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:41.180005 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.179988    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6q9p\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-kube-api-access-h6q9p\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.185931 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.185912    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdnwh\" (UniqueName: \"kubernetes.io/projected/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-kube-api-access-kdnwh\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:41.186899 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.186882    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhp4d\" (UniqueName: \"kubernetes.io/projected/cf675d26-93c5-4a45-90db-7f95e260ac30-kube-api-access-mhp4d\") pod \"kas-connection-checker-685895c7c9-8dw9x\" (UID: \"cf675d26-93c5-4a45-90db-7f95e260ac30\") " pod="kube-system/kas-connection-checker-685895c7c9-8dw9x"
Nov 03 17:16:41.187172 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.187152    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7zf6\" (UniqueName: \"kubernetes.io/projected/579ad6b2-cca6-4950-b2f2-1604e8757f1a-kube-api-access-w7zf6\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.187615 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.187599    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zkk6\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-kube-api-access-2zkk6\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.187904 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.187889    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzdj5\" (UniqueName: \"kubernetes.io/projected/b6a6ef43-27ed-4be0-becd-e5f455be56a8-kube-api-access-xzdj5\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:16:41.197852 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.197834    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-bound-sa-token\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.203642 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.203621    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nmhc2\""
Nov 03 17:16:41.204143 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.204127    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 03 17:16:41.204468 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.204442    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jrssc\""
Nov 03 17:16:41.204654 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.204639    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 03 17:16:41.204713 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.204671    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-57r42\""
Nov 03 17:16:41.204713 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.204686    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x9v6p\""
Nov 03 17:16:41.208516 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.208500    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w6wx\" (UniqueName: \"kubernetes.io/projected/749ecc85-b28a-4ecd-aaf0-27de9c332713-kube-api-access-5w6wx\") pod \"kas-connection-checker-685895c7c9-kpfdx\" (UID: \"749ecc85-b28a-4ecd-aaf0-27de9c332713\") " pod="kube-system/kas-connection-checker-685895c7c9-kpfdx"
Nov 03 17:16:41.209002 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.208978    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gnkq2\""
Nov 03 17:16:41.209076 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.208986    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 03 17:16:41.209275 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.209255    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 03 17:16:41.209356 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.209263    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Nov 03 17:16:41.209356 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.209294    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 03 17:16:41.209356 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.209313    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Nov 03 17:16:41.209542 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.209528    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 03 17:16:41.209775 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.209760    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 03 17:16:41.209873 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.209846    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-569sf\""
Nov 03 17:16:41.209948 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.209872    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-l2mxr\""
Nov 03 17:16:41.209948 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.209890    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-68gjk\""
Nov 03 17:16:41.210082 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.209995    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 03 17:16:41.210082 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.210007    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-whvtr\""
Nov 03 17:16:41.210082 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.210043    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-9lkll\""
Nov 03 17:16:41.210298 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.210280    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c6dxq\""
Nov 03 17:16:41.210360 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.210285    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-fmcvz\""
Nov 03 17:16:41.210360 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.210331    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-czdwp\""
Nov 03 17:16:41.210360 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.210339    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-h78gf\""
Nov 03 17:16:41.210546 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.210527    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlrxg\" (UniqueName: \"kubernetes.io/projected/12b0e63f-73f7-429a-879d-617267cc5f36-kube-api-access-nlrxg\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:41.210689 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.210674    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10d51151-30e6-4c36-a13b-5af9c5ba56e8-original-pull-secret\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:41.210993 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.210975    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mmd9\" (UniqueName: \"kubernetes.io/projected/a43a3fa1-f14d-4abc-95bb-1a1f21f25b01-kube-api-access-4mmd9\") pod \"volume-data-source-validator-58c9f5f46d-thckz\" (UID: \"a43a3fa1-f14d-4abc-95bb-1a1f21f25b01\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-thckz"
Nov 03 17:16:41.211051 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.210991    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h6tl4\""
Nov 03 17:16:41.211317 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.211302    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-mr6xr\""
Nov 03 17:16:41.211449 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.211367    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2ptg9\""
Nov 03 17:16:41.211647 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.211631    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kjm9\" (UniqueName: \"kubernetes.io/projected/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-kube-api-access-8kjm9\") pod \"iptables-alerter-8gpj4\" (UID: \"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c\") " pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:16:41.211764 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.211748    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Nov 03 17:16:41.211831 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.211817    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkwbc\" (UniqueName: \"kubernetes.io/projected/580c347a-163e-4e05-a1e4-497c10edb3ed-kube-api-access-qkwbc\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.211888 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.211873    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp727\" (UniqueName: \"kubernetes.io/projected/e4451ce6-8729-4567-9e85-d5eba0db6139-kube-api-access-mp727\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:41.212431 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.212408    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xhtw\" (UniqueName: \"kubernetes.io/projected/2f2e4d96-73c8-4a18-b4f7-97387ed44645-kube-api-access-4xhtw\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:41.213132 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.213118    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qk7gm\""
Nov 03 17:16:41.213210 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.213195    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f11f9269-8c8d-43da-a7f6-c766c17793c4-agent-certs\") pod \"konnectivity-agent-jjqzh\" (UID: \"f11f9269-8c8d-43da-a7f6-c766c17793c4\") " pod="kube-system/konnectivity-agent-jjqzh"
Nov 03 17:16:41.213763 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.213750    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-ovn-node-metrics-cert\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.214575 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.214560    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hwgrr\""
Nov 03 17:16:41.215823 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.215807    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnfnt\" (UniqueName: \"kubernetes.io/projected/98bb71f4-49c7-4216-b61e-f14b7b3a6368-kube-api-access-lnfnt\") pod \"migrator-66df5d496b-fb8hc\" (UID: \"98bb71f4-49c7-4216-b61e-f14b7b3a6368\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb8hc"
Nov 03 17:16:41.215869 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.215832    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88031944-e289-40ee-b002-884805e6bec6-data-volume\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:41.215869 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.215848    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-var-lib-kubelet\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.215869 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.215861    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-kubelet\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.215981 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.215881    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/80c620b9-0db9-47a5-a843-99d81db2ef95-signing-cabundle\") pod \"service-ca-5fffc97bdf-sch8k\" (UID: \"80c620b9-0db9-47a5-a843-99d81db2ef95\") " pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k"
Nov 03 17:16:41.215981 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.215946    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-var-lib-kubelet\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.215981 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.215957    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88031944-e289-40ee-b002-884805e6bec6-data-volume\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:41.215981 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.215966    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-kubelet\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.216121 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216020    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-sys-fs\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.216121 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216069    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-trusted-ca-bundle\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:41.216121 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216070    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/80c620b9-0db9-47a5-a843-99d81db2ef95-signing-cabundle\") pod \"service-ca-5fffc97bdf-sch8k\" (UID: \"80c620b9-0db9-47a5-a843-99d81db2ef95\") " pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k"
Nov 03 17:16:41.216121 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216099    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-device-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.216331 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216126    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-sys-fs\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.216331 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216131    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-kubernetes\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.216331 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216163    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-host\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.216331 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216184    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-device-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.216331 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216185    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-etc-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.216331 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216221    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-kubernetes\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.216331 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216253    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-ovn\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.216331 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216245    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-etc-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.216331 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216288    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-slash\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.216331 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216308    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-host\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.216331 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216331    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-slash\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.216672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216290    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-ovn\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.216672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216330    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-system-cni-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.216672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216378    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-system-cni-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.216672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216389    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-run-ovn-kubernetes\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.216672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216416    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-run-ovn-kubernetes\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.216672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216430    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-conf-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.216672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216480    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:41.216672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216513    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-conf-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.216672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216522    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-multus-certs\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.216672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216552    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-multus-certs\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.216672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216560    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:41.216672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216591    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.216672 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.216612    5021 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:41.216672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216620    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10d51151-30e6-4c36-a13b-5af9c5ba56e8-kubelet-config\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:41.216672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216655    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-trusted-ca-bundle\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:41.216672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216660    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-log-socket\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216699    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-etc-selinux\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216680    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10d51151-30e6-4c36-a13b-5af9c5ba56e8-kubelet-config\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216701    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-log-socket\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216658    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.216743    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls podName:e4451ce6-8729-4567-9e85-d5eba0db6139 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:41.716709095 +0000 UTC m=+1.918047132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2wbdt" (UID: "e4451ce6-8729-4567-9e85-d5eba0db6139") : secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216759    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysconfig\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216744    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-etc-selinux\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216776    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysctl-d\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216793    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-systemd\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216822    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-run-systemd\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216836    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysconfig\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216860    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-system-cni-dir\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216885    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-netns\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216917    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-system-cni-dir\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216907    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8ba695c-5928-49ec-9040-3e5171c81b4b-hosts-file\") pod \"node-resolver-jfpzv\" (UID: \"e8ba695c-5928-49ec-9040-3e5171c81b4b\") " pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216931    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-netns\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216934    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysctl-d\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216933    5021 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216962    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/80c620b9-0db9-47a5-a843-99d81db2ef95-signing-key\") pod \"service-ca-5fffc97bdf-sch8k\" (UID: \"80c620b9-0db9-47a5-a843-99d81db2ef95\") " pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216989    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f2jx\" (UniqueName: \"kubernetes.io/projected/80c620b9-0db9-47a5-a843-99d81db2ef95-kube-api-access-2f2jx\") pod \"service-ca-5fffc97bdf-sch8k\" (UID: \"80c620b9-0db9-47a5-a843-99d81db2ef95\") " pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217020    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217035    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-node-log\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217049    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.216999    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8ba695c-5928-49ec-9040-3e5171c81b4b-hosts-file\") pod \"node-resolver-jfpzv\" (UID: \"e8ba695c-5928-49ec-9040-3e5171c81b4b\") " pod="openshift-dns/node-resolver-jfpzv"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217092    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-node-log\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.217123    5021 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217124    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-modprobe-d\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.217136    5021 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5599885c48-cn2ff: secret "image-registry-tls" not found
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.217145    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle podName:12b0e63f-73f7-429a-879d-617267cc5f36 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:41.717127741 +0000 UTC m=+1.918465799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle") pod "router-default-678bd9c4d9-wrhq6" (UID: "12b0e63f-73f7-429a-879d-617267cc5f36") : configmap references non-existent config key: service-ca.crt
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217172    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-var-lib-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217196    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-socket-dir-parent\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217215    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/80c620b9-0db9-47a5-a843-99d81db2ef95-signing-key\") pod \"service-ca-5fffc97bdf-sch8k\" (UID: \"80c620b9-0db9-47a5-a843-99d81db2ef95\") " pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217245    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6e6d73d7-6236-4642-9b4c-74940e54057a-archives-path\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217275    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88031944-e289-40ee-b002-884805e6bec6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217213    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-modprobe-d\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.217289    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls podName:10a6a241-8eef-4bf1-b609-dd71d2042646 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:41.717273675 +0000 UTC m=+1.918611726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls") pod "image-registry-5599885c48-cn2ff" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646") : secret "image-registry-tls" not found
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217287    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-socket-dir-parent\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.217267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217243    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-var-lib-openvswitch\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217314    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6e6d73d7-6236-4642-9b4c-74940e54057a-archives-path\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217340    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-systemd-units\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217364    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-systemd-units\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217375    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-cni-multus\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217432    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-cni-bin\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217461    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh6ft\" (UniqueName: \"kubernetes.io/projected/2ef0f942-8c3c-43c9-bc45-a40b69188935-kube-api-access-mh6ft\") pod \"ingress-canary-gstrl\" (UID: \"2ef0f942-8c3c-43c9-bc45-a40b69188935\") " pod="openshift-ingress-canary/ingress-canary-gstrl"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217471    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-cni-multus\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217476    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-cni-bin\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217485    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-cnibin\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217511    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217544    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217574    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217600    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-cni-netd\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217626    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10d51151-30e6-4c36-a13b-5af9c5ba56e8-dbus\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.217634    5021 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217654    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cnibin\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.217662    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls podName:2f2e4d96-73c8-4a18-b4f7-97387ed44645 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:41.717653391 +0000 UTC m=+1.918991421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls") pod "dns-default-j4bd8" (UID: "2f2e4d96-73c8-4a18-b4f7-97387ed44645") : secret "dns-default-metrics-tls" not found
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.217678    5021 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217703    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-cnibin\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.217708    5021 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217731    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-cni-netd\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.217738    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs podName:26f7336a-a2b6-4f80-b417-a9a5d1648d69 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:41.717727683 +0000 UTC m=+1.919065714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs") pod "network-metrics-daemon-pvnlt" (UID: "26f7336a-a2b6-4f80-b417-a9a5d1648d69") : secret "metrics-daemon-secret" not found
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217515    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-cnibin\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217772    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10d51151-30e6-4c36-a13b-5af9c5ba56e8-dbus\") pod \"global-pull-secret-syncer-cfrm8\" (UID: \"10d51151-30e6-4c36-a13b-5af9c5ba56e8\") " pod="kube-system/global-pull-secret-syncer-cfrm8"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.217778    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert podName:0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:41.717763517 +0000 UTC m=+1.919101558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-jmrx4" (UID: "0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3") : secret "networking-console-plugin-cert" not found
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217769    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysctl-conf\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217802    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-run-netns\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217821    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-service-ca-bundle\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217838    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfgnv\" (UniqueName: \"kubernetes.io/projected/88031944-e289-40ee-b002-884805e6bec6-kube-api-access-pfgnv\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217871    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-run-netns\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217896    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217922    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq95k\" (UniqueName: \"kubernetes.io/projected/0414a02f-19b2-46cc-bf3e-884656ddee63-kube-api-access-rq95k\") pod \"migrator-66df5d496b-nbnrp\" (UID: \"0414a02f-19b2-46cc-bf3e-884656ddee63\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-nbnrp"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217950    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-systemd\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217945    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-sysctl-conf\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.217994    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218005    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6a6ef43-27ed-4be0-becd-e5f455be56a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sxmdm\" (UID: \"b6a6ef43-27ed-4be0-becd-e5f455be56a8\") " pod="openshift-multus/multus-additional-cni-plugins-sxmdm"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218018    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-run\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218028    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-service-ca-bundle\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218035    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-etc-systemd\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218041    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-lib-modules\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218061    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d47d6f3-b42c-4027-863e-e148d6d22726-host\") pod \"node-ca-5695n\" (UID: \"9d47d6f3-b42c-4027-863e-e148d6d22726\") " pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218079    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218082    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-run\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218098    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-cni-bin\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.218104    5021 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218125    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-socket-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218139    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d47d6f3-b42c-4027-863e-e148d6d22726-host\") pod \"node-ca-5695n\" (UID: \"9d47d6f3-b42c-4027-863e-e148d6d22726\") " pod="openshift-image-registry/node-ca-5695n"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.218147    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls podName:1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:41.718133212 +0000 UTC m=+1.919471262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-mgljp" (UID: "1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66") : secret "samples-operator-tls" not found
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218177    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-socket-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218179    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-cni-bin\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218191    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-hostroot\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218249    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-hostroot\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218249    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-etc-kubernetes\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218277    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-lib-modules\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218296    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-etc-kubernetes\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218289    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88031944-e289-40ee-b002-884805e6bec6-crio-socket\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218324    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-host-slash\") pod \"iptables-alerter-8gpj4\" (UID: \"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c\") " pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218340    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ef0f942-8c3c-43c9-bc45-a40b69188935-cert\") pod \"ingress-canary-gstrl\" (UID: \"2ef0f942-8c3c-43c9-bc45-a40b69188935\") " pod="openshift-ingress-canary/ingress-canary-gstrl"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218361    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shlzs\" (UniqueName: \"kubernetes.io/projected/6e6d73d7-6236-4642-9b4c-74940e54057a-kube-api-access-shlzs\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218383    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c-host-slash\") pod \"iptables-alerter-8gpj4\" (UID: \"6a07e44b-2d6e-47bf-8e8d-ab42abd0e61c\") " pod="openshift-network-operator/iptables-alerter-8gpj4"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218458    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218495    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-kubelet\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218523    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ef0f942-8c3c-43c9-bc45-a40b69188935-cert\") pod \"ingress-canary-gstrl\" (UID: \"2ef0f942-8c3c-43c9-bc45-a40b69188935\") " pod="openshift-ingress-canary/ingress-canary-gstrl"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218528    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218557    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-var-lib-kubelet\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218571    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.218579    5021 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.218593    5021 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c98dd6d65-rjtsq: secret "image-registry-tls" not found
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.218622    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls podName:836fc8fa-ebbb-4836-b453-2b9be6db8452 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:41.718611945 +0000 UTC m=+1.919950006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls") pod "image-registry-7c98dd6d65-rjtsq" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452") : secret "image-registry-tls" not found
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218555    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-registration-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218633    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-registration-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218651    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-k8s-cni-cncf-io\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218674    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-sys\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218688    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.218662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218703    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-cni-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.221091 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218745    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-host-run-k8s-cni-cncf-io\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.221091 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218755    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8322007d-27a3-43f8-b6d9-0d183f5e433f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2j77k\" (UID: \"8322007d-27a3-43f8-b6d9-0d183f5e433f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2j77k"
Nov 03 17:16:41.221091 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218790    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/580c347a-163e-4e05-a1e4-497c10edb3ed-multus-cni-dir\") pod \"multus-6dsbk\" (UID: \"580c347a-163e-4e05-a1e4-497c10edb3ed\") " pod="openshift-multus/multus-6dsbk"
Nov 03 17:16:41.221091 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.218802    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/579ad6b2-cca6-4950-b2f2-1604e8757f1a-sys\") pod \"tuned-cqgxc\" (UID: \"579ad6b2-cca6-4950-b2f2-1604e8757f1a\") " pod="openshift-cluster-node-tuning-operator/tuned-cqgxc"
Nov 03 17:16:41.221091 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.219650    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b0e63f-73f7-429a-879d-617267cc5f36-metrics-certs\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:41.221091 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.219823    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mbh7\" (UniqueName: \"kubernetes.io/projected/8ea83f1f-61e7-4236-a5e7-08c079de313b-kube-api-access-8mbh7\") pod \"insights-operator-7c4986d449-vsdc5\" (UID: \"8ea83f1f-61e7-4236-a5e7-08c079de313b\") " pod="openshift-insights/insights-operator-7c4986d449-vsdc5"
Nov 03 17:16:41.221091 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.220124    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8p68\" (UniqueName: \"kubernetes.io/projected/70c6fee2-4568-4dfc-85ff-cfd1fc1c8262-kube-api-access-j8p68\") pod \"ovnkube-node-tgppb\" (UID: \"70c6fee2-4568-4dfc-85ff-cfd1fc1c8262\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:41.221862 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.221848    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-d8tp8\""
Nov 03 17:16:41.222077 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.222061    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hvgjn\""
Nov 03 17:16:41.225012 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.224988    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27s7f\" (UniqueName: \"kubernetes.io/projected/32072064-dcf7-4c58-a5ef-47eeadb245e5-kube-api-access-27s7f\") pod \"service-ca-operator-544d749c8c-kscd2\" (UID: \"32072064-dcf7-4c58-a5ef-47eeadb245e5\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2"
Nov 03 17:16:41.276890 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.276865    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh6ft\" (UniqueName: \"kubernetes.io/projected/2ef0f942-8c3c-43c9-bc45-a40b69188935-kube-api-access-mh6ft\") pod \"ingress-canary-gstrl\" (UID: \"2ef0f942-8c3c-43c9-bc45-a40b69188935\") " pod="openshift-ingress-canary/ingress-canary-gstrl"
Nov 03 17:16:41.277197 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.277179    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnfnt\" (UniqueName: \"kubernetes.io/projected/98bb71f4-49c7-4216-b61e-f14b7b3a6368-kube-api-access-lnfnt\") pod \"migrator-66df5d496b-fb8hc\" (UID: \"98bb71f4-49c7-4216-b61e-f14b7b3a6368\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb8hc"
Nov 03 17:16:41.287660 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.287639    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq95k\" (UniqueName: \"kubernetes.io/projected/0414a02f-19b2-46cc-bf3e-884656ddee63-kube-api-access-rq95k\") pod \"migrator-66df5d496b-nbnrp\" (UID: \"0414a02f-19b2-46cc-bf3e-884656ddee63\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-nbnrp"
Nov 03 17:16:41.287833 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.287815    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shlzs\" (UniqueName: \"kubernetes.io/projected/6e6d73d7-6236-4642-9b4c-74940e54057a-kube-api-access-shlzs\") pod \"periodic-gathering-vjvw2-sht76\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") " pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:16:41.288137 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.288114    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfgnv\" (UniqueName: \"kubernetes.io/projected/88031944-e289-40ee-b002-884805e6bec6-kube-api-access-pfgnv\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:41.288686 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.288664    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f2jx\" (UniqueName: \"kubernetes.io/projected/80c620b9-0db9-47a5-a843-99d81db2ef95-kube-api-access-2f2jx\") pod \"service-ca-5fffc97bdf-sch8k\" (UID: \"80c620b9-0db9-47a5-a843-99d81db2ef95\") " pod="openshift-service-ca/service-ca-5fffc97bdf-sch8k"
Nov 03 17:16:41.319705 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.319678    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88031944-e289-40ee-b002-884805e6bec6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:41.319801 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.319750    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:41.319801 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.319776    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88031944-e289-40ee-b002-884805e6bec6-crio-socket\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:41.319912 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.319868    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88031944-e289-40ee-b002-884805e6bec6-crio-socket\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:41.319966 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.319908    5021 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 17:16:41.319966 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.319965    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls podName:88031944-e289-40ee-b002-884805e6bec6 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:41.819949644 +0000 UTC m=+2.021287688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lj8v" (UID: "88031944-e289-40ee-b002-884805e6bec6") : secret "insights-runtime-extractor-tls" not found
Nov 03 17:16:41.320275 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.320256    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88031944-e289-40ee-b002-884805e6bec6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:41.353429 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.353406    5021 scope.go:122] "RemoveContainer" containerID="397e426a106fa9ee5cc7b4d7b54c4318d67e32e35d40b6133c43ee2df4a50d14"
Nov 03 17:16:41.368648 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.368630    5021 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 17:16:41.724071 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.723991    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:41.724071 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.724038    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:41.724071 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.724059    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:41.724410 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.724093    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:41.724410 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.724163    5021 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:41.724410 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.724206    5021 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 17:16:41.724410 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.724218    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle podName:12b0e63f-73f7-429a-879d-617267cc5f36 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:42.724194858 +0000 UTC m=+2.925532902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle") pod "router-default-678bd9c4d9-wrhq6" (UID: "12b0e63f-73f7-429a-879d-617267cc5f36") : configmap references non-existent config key: service-ca.crt
Nov 03 17:16:41.724410 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.724247    5021 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:41.724410 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.724271    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls podName:2f2e4d96-73c8-4a18-b4f7-97387ed44645 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:42.724256131 +0000 UTC m=+2.925594176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls") pod "dns-default-j4bd8" (UID: "2f2e4d96-73c8-4a18-b4f7-97387ed44645") : secret "dns-default-metrics-tls" not found
Nov 03 17:16:41.724410 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.724292    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls podName:e4451ce6-8729-4567-9e85-d5eba0db6139 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:42.724280297 +0000 UTC m=+2.925618327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2wbdt" (UID: "e4451ce6-8729-4567-9e85-d5eba0db6139") : secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:41.724410 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.724270    5021 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5599885c48-cn2ff: secret "image-registry-tls" not found
Nov 03 17:16:41.724410 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.724308    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:41.724410 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.724338    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:41.724410 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.724371    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls podName:10a6a241-8eef-4bf1-b609-dd71d2042646 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:42.724356015 +0000 UTC m=+2.925694061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls") pod "image-registry-5599885c48-cn2ff" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646") : secret "image-registry-tls" not found
Nov 03 17:16:41.724410 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.724401    5021 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 03 17:16:41.724760 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.724429    5021 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 03 17:16:41.724760 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.724447    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs podName:26f7336a-a2b6-4f80-b417-a9a5d1648d69 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:42.724427123 +0000 UTC m=+2.925765152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs") pod "network-metrics-daemon-pvnlt" (UID: "26f7336a-a2b6-4f80-b417-a9a5d1648d69") : secret "metrics-daemon-secret" not found
Nov 03 17:16:41.724760 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.724465    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert podName:0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:42.724459206 +0000 UTC m=+2.925797236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-jmrx4" (UID: "0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3") : secret "networking-console-plugin-cert" not found
Nov 03 17:16:41.724760 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.724427    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:41.724760 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.724484    5021 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 03 17:16:41.724760 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.724530    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:41.724760 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.724590    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls podName:1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:42.724578557 +0000 UTC m=+2.925916587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-mgljp" (UID: "1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66") : secret "samples-operator-tls" not found
Nov 03 17:16:41.724760 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.724605    5021 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:41.724760 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.724614    5021 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c98dd6d65-rjtsq: secret "image-registry-tls" not found
Nov 03 17:16:41.724760 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.724642    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls podName:836fc8fa-ebbb-4836-b453-2b9be6db8452 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:42.724635709 +0000 UTC m=+2.925973743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls") pod "image-registry-7c98dd6d65-rjtsq" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452") : secret "image-registry-tls" not found
Nov 03 17:16:41.825352 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:41.825314    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:41.825534 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.825478    5021 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 17:16:41.825579 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:41.825547    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls podName:88031944-e289-40ee-b002-884805e6bec6 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:42.825533657 +0000 UTC m=+3.026871704 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lj8v" (UID: "88031944-e289-40ee-b002-884805e6bec6") : secret "insights-runtime-extractor-tls" not found
Nov 03 17:16:42.072396 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.072367    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:16:42.072838 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.072810    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/1.log"
Nov 03 17:16:42.072897 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.072850    5021 generic.go:356] "Generic (PLEG): container finished" podID="0caf85ea-1bec-4670-a2e1-3cafd0e5a587" containerID="58bec13c1793f3371a96aa8e2284a11091ae9e53de9fc2a8855e192353a41e21" exitCode=255
Nov 03 17:16:42.072942 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.072912    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq" event={"ID":"0caf85ea-1bec-4670-a2e1-3cafd0e5a587","Type":"ContainerDied","Data":"58bec13c1793f3371a96aa8e2284a11091ae9e53de9fc2a8855e192353a41e21"}
Nov 03 17:16:42.073020 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.072979    5021 scope.go:122] "RemoveContainer" containerID="397e426a106fa9ee5cc7b4d7b54c4318d67e32e35d40b6133c43ee2df4a50d14"
Nov 03 17:16:42.073317 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.073300    5021 scope.go:122] "RemoveContainer" containerID="58bec13c1793f3371a96aa8e2284a11091ae9e53de9fc2a8855e192353a41e21"
Nov 03 17:16:42.073533 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.073512    5021 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-6fwkq_openshift-console-operator(0caf85ea-1bec-4670-a2e1-3cafd0e5a587)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq" podUID="0caf85ea-1bec-4670-a2e1-3cafd0e5a587"
Nov 03 17:16:42.511836 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.511809    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:42.734586 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.734554    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:42.734741 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.734604    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:42.734741 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.734629    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:42.734741 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.734653    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:42.734741 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.734670    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:42.734741 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.734694    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:42.734741 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.734684    5021 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:42.734993 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.734750    5021 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:42.734993 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.734766    5021 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 17:16:42.734993 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.734774    5021 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5599885c48-cn2ff: secret "image-registry-tls" not found
Nov 03 17:16:42.734993 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.734784    5021 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 03 17:16:42.734993 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.734769    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls podName:e4451ce6-8729-4567-9e85-d5eba0db6139 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:44.734751608 +0000 UTC m=+4.936089638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2wbdt" (UID: "e4451ce6-8729-4567-9e85-d5eba0db6139") : secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:42.734993 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.734815    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:42.734993 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.734823    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs podName:26f7336a-a2b6-4f80-b417-a9a5d1648d69 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:44.73480977 +0000 UTC m=+4.936147803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs") pod "network-metrics-daemon-pvnlt" (UID: "26f7336a-a2b6-4f80-b417-a9a5d1648d69") : secret "metrics-daemon-secret" not found
Nov 03 17:16:42.734993 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.734827    5021 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 03 17:16:42.734993 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.734849    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle podName:12b0e63f-73f7-429a-879d-617267cc5f36 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:44.734838168 +0000 UTC m=+4.936176206 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle") pod "router-default-678bd9c4d9-wrhq6" (UID: "12b0e63f-73f7-429a-879d-617267cc5f36") : configmap references non-existent config key: service-ca.crt
Nov 03 17:16:42.734993 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.734866    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls podName:2f2e4d96-73c8-4a18-b4f7-97387ed44645 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:44.734858926 +0000 UTC m=+4.936196957 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls") pod "dns-default-j4bd8" (UID: "2f2e4d96-73c8-4a18-b4f7-97387ed44645") : secret "dns-default-metrics-tls" not found
Nov 03 17:16:42.734993 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.734881    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls podName:10a6a241-8eef-4bf1-b609-dd71d2042646 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:44.734874221 +0000 UTC m=+4.936212251 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls") pod "image-registry-5599885c48-cn2ff" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646") : secret "image-registry-tls" not found
Nov 03 17:16:42.734993 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.734902    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert podName:0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:44.734892039 +0000 UTC m=+4.936230069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-jmrx4" (UID: "0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3") : secret "networking-console-plugin-cert" not found
Nov 03 17:16:42.734993 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.734962    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:42.735406 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.735070    5021 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:42.735406 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.735083    5021 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c98dd6d65-rjtsq: secret "image-registry-tls" not found
Nov 03 17:16:42.735406 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.735123    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls podName:836fc8fa-ebbb-4836-b453-2b9be6db8452 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:44.735111607 +0000 UTC m=+4.936449641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls") pod "image-registry-7c98dd6d65-rjtsq" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452") : secret "image-registry-tls" not found
Nov 03 17:16:42.737191 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.737173    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-mgljp\" (UID: \"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:42.836456 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.836380    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:42.836594 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.836525    5021 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 17:16:42.836594 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:42.836589    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls podName:88031944-e289-40ee-b002-884805e6bec6 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:44.836574644 +0000 UTC m=+5.037912701 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lj8v" (UID: "88031944-e289-40ee-b002-884805e6bec6") : secret "insights-runtime-extractor-tls" not found
Nov 03 17:16:42.853354 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:42.853327    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"
Nov 03 17:16:43.043980 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:43.043953    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jfpzv_e8ba695c-5928-49ec-9040-3e5171c81b4b/dns-node-resolver/0.log"
Nov 03 17:16:43.077733 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:43.077703    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:16:43.079257 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:43.079211    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fb8hc" event={"ID":"98bb71f4-49c7-4216-b61e-f14b7b3a6368","Type":"ContainerStarted","Data":"9724a428b6fbd5977bcc402b8d040cb5e074ea3c6a34e494f2134c629fc697d9"}
Nov 03 17:16:43.080600 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:43.080575    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-nbnrp" event={"ID":"0414a02f-19b2-46cc-bf3e-884656ddee63","Type":"ContainerStarted","Data":"8688e8c9a7f82bcff369c22a3571e6bb7eec5ceafdc988e17d042b6d09add805"}
Nov 03 17:16:43.220126 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:43.220049    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp"]
Nov 03 17:16:43.638392 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:43.638361    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5695n_9d47d6f3-b42c-4027-863e-e148d6d22726/node-ca/0.log"
Nov 03 17:16:44.085041 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.085008    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp" event={"ID":"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66","Type":"ContainerStarted","Data":"493c2b729b599ffbcbc4b511085d49844b8e5778fbf09e5f7ec7fba6778c28b1"}
Nov 03 17:16:44.194131 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.194089    5021 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:44.194510 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.194486    5021 scope.go:122] "RemoveContainer" containerID="58bec13c1793f3371a96aa8e2284a11091ae9e53de9fc2a8855e192353a41e21"
Nov 03 17:16:44.194698 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:44.194676    5021 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-6fwkq_openshift-console-operator(0caf85ea-1bec-4670-a2e1-3cafd0e5a587)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq" podUID="0caf85ea-1bec-4670-a2e1-3cafd0e5a587"
Nov 03 17:16:44.235666 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.235636    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:16:44.246034 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.246011    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gstrl_2ef0f942-8c3c-43c9-bc45-a40b69188935/serve-healthcheck-canary/0.log"
Nov 03 17:16:44.439944 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.439862    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-fb8hc_98bb71f4-49c7-4216-b61e-f14b7b3a6368/migrator/0.log"
Nov 03 17:16:44.644135 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.644093    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-nbnrp_0414a02f-19b2-46cc-bf3e-884656ddee63/migrator/0.log"
Nov 03 17:16:44.754106 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.754080    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:44.754277 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.754189    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:44.754277 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:44.754253    5021 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 03 17:16:44.754362 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.754285    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:44.754362 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:44.754334    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs podName:26f7336a-a2b6-4f80-b417-a9a5d1648d69 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:48.754315571 +0000 UTC m=+8.955653626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs") pod "network-metrics-daemon-pvnlt" (UID: "26f7336a-a2b6-4f80-b417-a9a5d1648d69") : secret "metrics-daemon-secret" not found
Nov 03 17:16:44.754439 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:44.754370    5021 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:44.754439 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.754371    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:44.754439 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.754401    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:44.754439 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:44.754332    5021 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:44.754439 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:44.754419    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls podName:e4451ce6-8729-4567-9e85-d5eba0db6139 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:48.754407944 +0000 UTC m=+8.955745990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-2wbdt" (UID: "e4451ce6-8729-4567-9e85-d5eba0db6139") : secret "cluster-monitoring-operator-tls" not found
Nov 03 17:16:44.754605 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:44.754421    5021 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c98dd6d65-rjtsq: secret "image-registry-tls" not found
Nov 03 17:16:44.754605 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.754465    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:44.754605 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:44.754474    5021 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:44.754605 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:44.754484    5021 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5599885c48-cn2ff: secret "image-registry-tls" not found
Nov 03 17:16:44.754605 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.754494    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:44.754605 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:44.754514    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls podName:10a6a241-8eef-4bf1-b609-dd71d2042646 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:48.754505048 +0000 UTC m=+8.955843095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls") pod "image-registry-5599885c48-cn2ff" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646") : secret "image-registry-tls" not found
Nov 03 17:16:44.754605 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:44.754551    5021 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 03 17:16:44.754605 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:44.754571    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls podName:836fc8fa-ebbb-4836-b453-2b9be6db8452 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:48.754561248 +0000 UTC m=+8.955899285 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls") pod "image-registry-7c98dd6d65-rjtsq" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452") : secret "image-registry-tls" not found
Nov 03 17:16:44.754605 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:44.754586    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert podName:0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:48.754577901 +0000 UTC m=+8.955915934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-jmrx4" (UID: "0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3") : secret "networking-console-plugin-cert" not found
Nov 03 17:16:44.754605 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:44.754589    5021 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 17:16:44.754938 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:44.754635    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls podName:2f2e4d96-73c8-4a18-b4f7-97387ed44645 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:48.754616786 +0000 UTC m=+8.955954819 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls") pod "dns-default-j4bd8" (UID: "2f2e4d96-73c8-4a18-b4f7-97387ed44645") : secret "dns-default-metrics-tls" not found
Nov 03 17:16:44.754980 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.754951    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12b0e63f-73f7-429a-879d-617267cc5f36-service-ca-bundle\") pod \"router-default-678bd9c4d9-wrhq6\" (UID: \"12b0e63f-73f7-429a-879d-617267cc5f36\") " pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:44.839374 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.839341    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-btzt2_7ba6ecd5-1d02-4433-b245-1c957827467e/kube-storage-version-migrator-operator/0.log"
Nov 03 17:16:44.855924 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.855893    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:44.856084 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:44.856063    5021 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 17:16:44.856165 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:44.856153    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls podName:88031944-e289-40ee-b002-884805e6bec6 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:48.856136177 +0000 UTC m=+9.057474224 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lj8v" (UID: "88031944-e289-40ee-b002-884805e6bec6") : secret "insights-runtime-extractor-tls" not found
Nov 03 17:16:44.955442 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:44.955408    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:45.428875 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:45.428801    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-678bd9c4d9-wrhq6"]
Nov 03 17:16:45.435161 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:45.435128    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12b0e63f_73f7_429a_879d_617267cc5f36.slice/crio-8b46723343e1526230cd8e11d5cf5c710d0b8305edc748a7196fb36f7ed7e599 WatchSource:0}: Error finding container 8b46723343e1526230cd8e11d5cf5c710d0b8305edc748a7196fb36f7ed7e599: Status 404 returned error can't find the container with id 8b46723343e1526230cd8e11d5cf5c710d0b8305edc748a7196fb36f7ed7e599
Nov 03 17:16:46.093378 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:46.093343    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp" event={"ID":"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66","Type":"ContainerStarted","Data":"0fdd78b0e31d616e5253872b8c23d0516b3a15c26a6dcfe60c7ed674f2abc053"}
Nov 03 17:16:46.093571 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:46.093403    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-mgljp" event={"ID":"1f4ceafe-e8ee-47a1-8ccb-6250b8a9eb66","Type":"ContainerStarted","Data":"f9d2e7e003139e7c2b7d6cb911e28110063ef245c962ea04c171c711f3e5af02"}
Nov 03 17:16:46.094801 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:46.094777    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-678bd9c4d9-wrhq6" event={"ID":"12b0e63f-73f7-429a-879d-617267cc5f36","Type":"ContainerStarted","Data":"a0910b807323f2893b42c176d947aa19c7d196e73b0b6e2eb2e93635bf6c3db0"}
Nov 03 17:16:46.094908 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:46.094815    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-678bd9c4d9-wrhq6" event={"ID":"12b0e63f-73f7-429a-879d-617267cc5f36","Type":"ContainerStarted","Data":"8b46723343e1526230cd8e11d5cf5c710d0b8305edc748a7196fb36f7ed7e599"}
Nov 03 17:16:46.225753 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:46.225676    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:46.225926 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:46.225914    5021 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 03 17:16:46.955721 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:46.955688    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:46.958243 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:46.958199    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:48.101475 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.101437    5021 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 03 17:16:48.437542 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.437449    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:48.437900 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.437881    5021 scope.go:122] "RemoveContainer" containerID="58bec13c1793f3371a96aa8e2284a11091ae9e53de9fc2a8855e192353a41e21"
Nov 03 17:16:48.438117 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:48.438095    5021 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-6fwkq_openshift-console-operator(0caf85ea-1bec-4670-a2e1-3cafd0e5a587)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq" podUID="0caf85ea-1bec-4670-a2e1-3cafd0e5a587"
Nov 03 17:16:48.796285 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.796246    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:48.796485 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.796294    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:48.796485 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.796320    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:48.796485 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.796351    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:48.796485 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.796411    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:48.796485 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:48.796415    5021 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:48.796485 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:48.796439    5021 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5599885c48-cn2ff: secret "image-registry-tls" not found
Nov 03 17:16:48.796485 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.796478    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:48.797019 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:48.796505    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls podName:10a6a241-8eef-4bf1-b609-dd71d2042646 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:56.796484457 +0000 UTC m=+16.997822514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls") pod "image-registry-5599885c48-cn2ff" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646") : secret "image-registry-tls" not found
Nov 03 17:16:48.797019 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:48.796594    5021 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 03 17:16:48.797019 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:48.796607    5021 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c98dd6d65-rjtsq: secret "image-registry-tls" not found
Nov 03 17:16:48.797019 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:48.796654    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls podName:836fc8fa-ebbb-4836-b453-2b9be6db8452 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:56.796640719 +0000 UTC m=+16.997978765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls") pod "image-registry-7c98dd6d65-rjtsq" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452") : secret "image-registry-tls" not found
Nov 03 17:16:48.798791 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.798766    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26f7336a-a2b6-4f80-b417-a9a5d1648d69-metrics-certs\") pod \"network-metrics-daemon-pvnlt\" (UID: \"26f7336a-a2b6-4f80-b417-a9a5d1648d69\") " pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:48.798884 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.798835    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-jmrx4\" (UID: \"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:48.799071 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.799053    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2e4d96-73c8-4a18-b4f7-97387ed44645-metrics-tls\") pod \"dns-default-j4bd8\" (UID: \"2f2e4d96-73c8-4a18-b4f7-97387ed44645\") " pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:48.799149 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.799131    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4451ce6-8729-4567-9e85-d5eba0db6139-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-2wbdt\" (UID: \"e4451ce6-8729-4567-9e85-d5eba0db6139\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:48.856143 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.856111    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"
Nov 03 17:16:48.856301 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.856146    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"
Nov 03 17:16:48.864781 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.864759    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvnlt"
Nov 03 17:16:48.866928 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.866906    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:48.897326 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:48.897209    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:48.897605 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:48.897479    5021 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 17:16:48.897605 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:16:48.897580    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls podName:88031944-e289-40ee-b002-884805e6bec6 nodeName:}" failed. No retries permitted until 2026-11-03 17:16:56.897557776 +0000 UTC m=+17.098895809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lj8v" (UID: "88031944-e289-40ee-b002-884805e6bec6") : secret "insights-runtime-extractor-tls" not found
Nov 03 17:16:49.343460 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:49.343425    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-jmrx4"]
Nov 03 17:16:49.344187 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:49.344161    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pvnlt"]
Nov 03 17:16:49.349676 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:49.349648    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f7336a_a2b6_4f80_b417_a9a5d1648d69.slice/crio-e6a259ff64cf38136b4e1eabe4f0efcea82fdff581b710b7499f0c4f0fff905f WatchSource:0}: Error finding container e6a259ff64cf38136b4e1eabe4f0efcea82fdff581b710b7499f0c4f0fff905f: Status 404 returned error can't find the container with id e6a259ff64cf38136b4e1eabe4f0efcea82fdff581b710b7499f0c4f0fff905f
Nov 03 17:16:49.350400 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:49.350376    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b52df09_a7d4_4ec2_b3fa_b824e0a9b8e3.slice/crio-3dc6ef3daf9190c35a5e066322da60f73daf64f69163c1e961749f5d91194f50 WatchSource:0}: Error finding container 3dc6ef3daf9190c35a5e066322da60f73daf64f69163c1e961749f5d91194f50: Status 404 returned error can't find the container with id 3dc6ef3daf9190c35a5e066322da60f73daf64f69163c1e961749f5d91194f50
Nov 03 17:16:49.391355 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:49.391322    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt"]
Nov 03 17:16:49.391896 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:49.391874    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j4bd8"]
Nov 03 17:16:49.400021 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:49.399990    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4451ce6_8729_4567_9e85_d5eba0db6139.slice/crio-219c99f40dfd84c7c5f373fe47a429c055aafd6ea40b7e23eba0ea1199cf8a62 WatchSource:0}: Error finding container 219c99f40dfd84c7c5f373fe47a429c055aafd6ea40b7e23eba0ea1199cf8a62: Status 404 returned error can't find the container with id 219c99f40dfd84c7c5f373fe47a429c055aafd6ea40b7e23eba0ea1199cf8a62
Nov 03 17:16:49.400556 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:49.400534    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f2e4d96_73c8_4a18_b4f7_97387ed44645.slice/crio-5e9b43cb9063202f19fafe98252f3ea6ebd6aa3a62d366b6bbc4b14998d98fcd WatchSource:0}: Error finding container 5e9b43cb9063202f19fafe98252f3ea6ebd6aa3a62d366b6bbc4b14998d98fcd: Status 404 returned error can't find the container with id 5e9b43cb9063202f19fafe98252f3ea6ebd6aa3a62d366b6bbc4b14998d98fcd
Nov 03 17:16:50.113113 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:50.113071    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pvnlt" event={"ID":"26f7336a-a2b6-4f80-b417-a9a5d1648d69","Type":"ContainerStarted","Data":"e6a259ff64cf38136b4e1eabe4f0efcea82fdff581b710b7499f0c4f0fff905f"}
Nov 03 17:16:50.114129 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:50.114103    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j4bd8" event={"ID":"2f2e4d96-73c8-4a18-b4f7-97387ed44645","Type":"ContainerStarted","Data":"5e9b43cb9063202f19fafe98252f3ea6ebd6aa3a62d366b6bbc4b14998d98fcd"}
Nov 03 17:16:50.115284 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:50.115257    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4" event={"ID":"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3","Type":"ContainerStarted","Data":"3dc6ef3daf9190c35a5e066322da60f73daf64f69163c1e961749f5d91194f50"}
Nov 03 17:16:50.116336 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:50.116310    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt" event={"ID":"e4451ce6-8729-4567-9e85-d5eba0db6139","Type":"ContainerStarted","Data":"219c99f40dfd84c7c5f373fe47a429c055aafd6ea40b7e23eba0ea1199cf8a62"}
Nov 03 17:16:51.746258 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:51.746204    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:51.746693 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:51.746366    5021 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 03 17:16:51.747913 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:51.747887    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-678bd9c4d9-wrhq6"
Nov 03 17:16:51.997202 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:51.997114    5021 scope.go:122] "RemoveContainer" containerID="58bec13c1793f3371a96aa8e2284a11091ae9e53de9fc2a8855e192353a41e21"
Nov 03 17:16:52.128277 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:52.128243    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:16:52.128426 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:52.128359    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq" event={"ID":"0caf85ea-1bec-4670-a2e1-3cafd0e5a587","Type":"ContainerStarted","Data":"72f18fa64740646b64127b516254a32d96f8aee5443a88fd63155048bb38baeb"}
Nov 03 17:16:52.128655 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:52.128618    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:52.129758 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:52.129734    5021 patch_prober.go:29] interesting pod/console-operator-7cd56b8dbc-6fwkq container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" start-of-body=
Nov 03 17:16:52.129868 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:52.129775    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq" podUID="0caf85ea-1bec-4670-a2e1-3cafd0e5a587" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused"
Nov 03 17:16:52.130383 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:52.130350    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pvnlt" event={"ID":"26f7336a-a2b6-4f80-b417-a9a5d1648d69","Type":"ContainerStarted","Data":"a83c86f995f1decdd2f091fd4a2da86225436a3ce78307f175314d3c4d7dda9f"}
Nov 03 17:16:52.130482 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:52.130402    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pvnlt" event={"ID":"26f7336a-a2b6-4f80-b417-a9a5d1648d69","Type":"ContainerStarted","Data":"8b2c0e7bd60a2c3eb8e638a0483d1dbd3cb045409a84616665a139fee7326df0"}
Nov 03 17:16:52.132277 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:52.132252    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j4bd8" event={"ID":"2f2e4d96-73c8-4a18-b4f7-97387ed44645","Type":"ContainerStarted","Data":"457f067c5bb53e7dddedd2789c8c19ad5b255575c61e36c6ee3cdf5e2690c22c"}
Nov 03 17:16:52.132393 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:52.132301    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j4bd8" event={"ID":"2f2e4d96-73c8-4a18-b4f7-97387ed44645","Type":"ContainerStarted","Data":"4865025ffcb9143a6aee205ab200b1686f4014b146467fe45b11fccb109aa5d4"}
Nov 03 17:16:52.132393 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:52.132343    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:16:52.133766 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:52.133746    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-jmrx4" event={"ID":"0b52df09-a7d4-4ec2-b3fa-b824e0a9b8e3","Type":"ContainerStarted","Data":"fe22612511282716e3aeb3f36d261a8c88289f9e055536a18865fc231946466f"}
Nov 03 17:16:52.135204 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:52.135182    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-2wbdt" event={"ID":"e4451ce6-8729-4567-9e85-d5eba0db6139","Type":"ContainerStarted","Data":"7d6b8249360b95582b21c8d023b69a14280aa99c6b04d6ead48e80cb5135c373"}
Nov 03 17:16:53.142494 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:53.142465    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-6fwkq"
Nov 03 17:16:56.851416 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:56.851385    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgppb"
Nov 03 17:16:56.867881 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:56.867852    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:56.868152 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:56.868133    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:56.870061 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:56.870031    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls\") pod \"image-registry-7c98dd6d65-rjtsq\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") " pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:56.870304 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:56.870287    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls\") pod \"image-registry-5599885c48-cn2ff\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") " pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:56.954963 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:56.954931    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:56.967944 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:56.967856    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:56.969238 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:56.969195    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:56.971985 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:56.971932    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88031944-e289-40ee-b002-884805e6bec6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lj8v\" (UID: \"88031944-e289-40ee-b002-884805e6bec6\") " pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:57.270261 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:57.270218    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9lj8v"
Nov 03 17:16:57.388296 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:57.388261    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c98dd6d65-rjtsq"]
Nov 03 17:16:57.391205 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:57.391177    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5599885c48-cn2ff"]
Nov 03 17:16:57.394846 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:57.394823    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod836fc8fa_ebbb_4836_b453_2b9be6db8452.slice/crio-3e48f1f0c54b1b125da96ea7ac9a277a4ba8e21208c356960ad1eb3e2e4e72fb WatchSource:0}: Error finding container 3e48f1f0c54b1b125da96ea7ac9a277a4ba8e21208c356960ad1eb3e2e4e72fb: Status 404 returned error can't find the container with id 3e48f1f0c54b1b125da96ea7ac9a277a4ba8e21208c356960ad1eb3e2e4e72fb
Nov 03 17:16:57.397146 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:57.397124    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10a6a241_8eef_4bf1_b609_dd71d2042646.slice/crio-e55350805b35fa559f3683788b4e314d52a85d1ee1ac65ba809d0e437fae403c WatchSource:0}: Error finding container e55350805b35fa559f3683788b4e314d52a85d1ee1ac65ba809d0e437fae403c: Status 404 returned error can't find the container with id e55350805b35fa559f3683788b4e314d52a85d1ee1ac65ba809d0e437fae403c
Nov 03 17:16:57.640331 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:57.640260    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9lj8v"]
Nov 03 17:16:57.647055 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:16:57.647025    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88031944_e289_40ee_b002_884805e6bec6.slice/crio-08262086e903c76753d689092bc8f93b56397ed24ee9c44a9f1789c0f02c7034 WatchSource:0}: Error finding container 08262086e903c76753d689092bc8f93b56397ed24ee9c44a9f1789c0f02c7034: Status 404 returned error can't find the container with id 08262086e903c76753d689092bc8f93b56397ed24ee9c44a9f1789c0f02c7034
Nov 03 17:16:58.160792 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:58.160724    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9lj8v" event={"ID":"88031944-e289-40ee-b002-884805e6bec6","Type":"ContainerStarted","Data":"82277e6d5ccc6af74c93a3081428eb69970377b30ff9875f4a7bc9b651f1f032"}
Nov 03 17:16:58.161311 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:58.160813    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9lj8v" event={"ID":"88031944-e289-40ee-b002-884805e6bec6","Type":"ContainerStarted","Data":"08262086e903c76753d689092bc8f93b56397ed24ee9c44a9f1789c0f02c7034"}
Nov 03 17:16:58.162294 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:58.162257    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5599885c48-cn2ff" event={"ID":"10a6a241-8eef-4bf1-b609-dd71d2042646","Type":"ContainerStarted","Data":"60198dee04f726e6e71e78695f69707fd5005bdefc0b7f78e04550296265db76"}
Nov 03 17:16:58.162417 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:58.162309    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5599885c48-cn2ff" event={"ID":"10a6a241-8eef-4bf1-b609-dd71d2042646","Type":"ContainerStarted","Data":"e55350805b35fa559f3683788b4e314d52a85d1ee1ac65ba809d0e437fae403c"}
Nov 03 17:16:58.162417 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:58.162338    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:16:58.163743 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:58.163718    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq" event={"ID":"836fc8fa-ebbb-4836-b453-2b9be6db8452","Type":"ContainerStarted","Data":"17c198ccb8f065661db08c58ab7fa4292d9315699756060c2496cfed7e599fd0"}
Nov 03 17:16:58.163825 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:58.163754    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq" event={"ID":"836fc8fa-ebbb-4836-b453-2b9be6db8452","Type":"ContainerStarted","Data":"3e48f1f0c54b1b125da96ea7ac9a277a4ba8e21208c356960ad1eb3e2e4e72fb"}
Nov 03 17:16:58.163896 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:58.163857    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:16:59.170282 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:16:59.170181    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9lj8v" event={"ID":"88031944-e289-40ee-b002-884805e6bec6","Type":"ContainerStarted","Data":"431469a17b758842e75562baa902fe0c91f4a3da2eac8977118d15e70293eda1"}
Nov 03 17:17:00.094559 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.094522    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c98dd6d65-rjtsq"]
Nov 03 17:17:00.134261 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.134201    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-ccfc97f7b-6nkbq"]
Nov 03 17:17:00.137986 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.137948    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.159857 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.159827    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-v77q9"]
Nov 03 17:17:00.166110 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.166074    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-v77q9"
Nov 03 17:17:00.169337 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.169299    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-l5d49"]
Nov 03 17:17:00.172488 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.172468    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-l5d49"
Nov 03 17:17:00.197303 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.197270    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4g84\" (UniqueName: \"kubernetes.io/projected/2dbbea70-2a0b-45f8-9c29-58bdfff76d74-kube-api-access-l4g84\") pod \"downloads-6dd789c8b7-l5d49\" (UID: \"2dbbea70-2a0b-45f8-9c29-58bdfff76d74\") " pod="openshift-console/downloads-6dd789c8b7-l5d49"
Nov 03 17:17:00.197417 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.197333    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdcbh\" (UniqueName: \"kubernetes.io/projected/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-kube-api-access-xdcbh\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.197476 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.197444    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2dbbea70-2a0b-45f8-9c29-58bdfff76d74-tmp\") pod \"downloads-6dd789c8b7-l5d49\" (UID: \"2dbbea70-2a0b-45f8-9c29-58bdfff76d74\") " pod="openshift-console/downloads-6dd789c8b7-l5d49"
Nov 03 17:17:00.197541 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.197498    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-registry-certificates\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.197613 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.197590    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-trusted-ca\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.197731 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.197627    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/67f75b9b-4d90-46f1-942f-e3fb290e46d3-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-v77q9\" (UID: \"67f75b9b-4d90-46f1-942f-e3fb290e46d3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-v77q9"
Nov 03 17:17:00.197731 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.197669    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-image-registry-private-configuration\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.197842 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.197730    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-installation-pull-secrets\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.197842 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.197829    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-registry-tls\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.197936 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.197855    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-ca-trust-extracted\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.197936 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.197901    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-bound-sa-token\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.217588 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.217559    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-ccfc97f7b-6nkbq"]
Nov 03 17:17:00.242852 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.242822    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Nov 03 17:17:00.243077 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.243054    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Nov 03 17:17:00.243331 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.243297    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-qnk5c\""
Nov 03 17:17:00.243410 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.243329    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-tvbjq\""
Nov 03 17:17:00.243511 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.243488    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Nov 03 17:17:00.245334 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.245092    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-v77q9"]
Nov 03 17:17:00.284568 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.284537    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-l5d49"]
Nov 03 17:17:00.299163 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.299127    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-installation-pull-secrets\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.299163 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.299169    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-registry-tls\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.299394 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.299187    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-ca-trust-extracted\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.299394 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.299212    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-bound-sa-token\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.299394 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.299249    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4g84\" (UniqueName: \"kubernetes.io/projected/2dbbea70-2a0b-45f8-9c29-58bdfff76d74-kube-api-access-l4g84\") pod \"downloads-6dd789c8b7-l5d49\" (UID: \"2dbbea70-2a0b-45f8-9c29-58bdfff76d74\") " pod="openshift-console/downloads-6dd789c8b7-l5d49"
Nov 03 17:17:00.299394 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.299277    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdcbh\" (UniqueName: \"kubernetes.io/projected/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-kube-api-access-xdcbh\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.299394 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.299322    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2dbbea70-2a0b-45f8-9c29-58bdfff76d74-tmp\") pod \"downloads-6dd789c8b7-l5d49\" (UID: \"2dbbea70-2a0b-45f8-9c29-58bdfff76d74\") " pod="openshift-console/downloads-6dd789c8b7-l5d49"
Nov 03 17:17:00.299394 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.299357    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-registry-certificates\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.299642 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.299400    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-trusted-ca\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.299642 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.299430    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/67f75b9b-4d90-46f1-942f-e3fb290e46d3-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-v77q9\" (UID: \"67f75b9b-4d90-46f1-942f-e3fb290e46d3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-v77q9"
Nov 03 17:17:00.299642 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.299472    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-image-registry-private-configuration\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.300375 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.300336    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-ca-trust-extracted\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.300710 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.300682    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-registry-certificates\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.300858 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.300735    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2dbbea70-2a0b-45f8-9c29-58bdfff76d74-tmp\") pod \"downloads-6dd789c8b7-l5d49\" (UID: \"2dbbea70-2a0b-45f8-9c29-58bdfff76d74\") " pod="openshift-console/downloads-6dd789c8b7-l5d49"
Nov 03 17:17:00.301904 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.301838    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-trusted-ca\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.302345 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.302293    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-installation-pull-secrets\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.302788 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.302769    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-image-registry-private-configuration\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.303195 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.303175    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/67f75b9b-4d90-46f1-942f-e3fb290e46d3-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-v77q9\" (UID: \"67f75b9b-4d90-46f1-942f-e3fb290e46d3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-v77q9"
Nov 03 17:17:00.303282 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.303255    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-registry-tls\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.359713 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.359644    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdcbh\" (UniqueName: \"kubernetes.io/projected/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-kube-api-access-xdcbh\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.359835 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.359715    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4g84\" (UniqueName: \"kubernetes.io/projected/2dbbea70-2a0b-45f8-9c29-58bdfff76d74-kube-api-access-l4g84\") pod \"downloads-6dd789c8b7-l5d49\" (UID: \"2dbbea70-2a0b-45f8-9c29-58bdfff76d74\") " pod="openshift-console/downloads-6dd789c8b7-l5d49"
Nov 03 17:17:00.362558 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.362536    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7b688a0-df63-47e1-96c3-8d17aad4f7fc-bound-sa-token\") pod \"image-registry-ccfc97f7b-6nkbq\" (UID: \"b7b688a0-df63-47e1-96c3-8d17aad4f7fc\") " pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.452724 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.452688    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:00.490997 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.490958    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-v77q9"
Nov 03 17:17:00.503352 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.503321    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-l5d49"
Nov 03 17:17:00.886950 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.886921    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-ccfc97f7b-6nkbq"]
Nov 03 17:17:00.892427 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:17:00.892398    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b688a0_df63_47e1_96c3_8d17aad4f7fc.slice/crio-4a0bcc026b442a9a2df5b7efffdfec27763c1d4c64f941f08e97193bfa22ab20 WatchSource:0}: Error finding container 4a0bcc026b442a9a2df5b7efffdfec27763c1d4c64f941f08e97193bfa22ab20: Status 404 returned error can't find the container with id 4a0bcc026b442a9a2df5b7efffdfec27763c1d4c64f941f08e97193bfa22ab20
Nov 03 17:17:00.934768 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.934741    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-v77q9"]
Nov 03 17:17:00.937530 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:00.937505    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-l5d49"]
Nov 03 17:17:00.941424 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:17:00.941399    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f75b9b_4d90_46f1_942f_e3fb290e46d3.slice/crio-118be21e5280b43ae25c1a1ce42b830ece9ecbab5fd15da3c4765b0b3033d049 WatchSource:0}: Error finding container 118be21e5280b43ae25c1a1ce42b830ece9ecbab5fd15da3c4765b0b3033d049: Status 404 returned error can't find the container with id 118be21e5280b43ae25c1a1ce42b830ece9ecbab5fd15da3c4765b0b3033d049
Nov 03 17:17:00.943273 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:17:00.943242    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dbbea70_2a0b_45f8_9c29_58bdfff76d74.slice/crio-688207cbbd7d5d5ac0675e642ca5dfe0ad40a059c441875beefe480023e10110 WatchSource:0}: Error finding container 688207cbbd7d5d5ac0675e642ca5dfe0ad40a059c441875beefe480023e10110: Status 404 returned error can't find the container with id 688207cbbd7d5d5ac0675e642ca5dfe0ad40a059c441875beefe480023e10110
Nov 03 17:17:01.188411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:01.188323    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-v77q9" event={"ID":"67f75b9b-4d90-46f1-942f-e3fb290e46d3","Type":"ContainerStarted","Data":"118be21e5280b43ae25c1a1ce42b830ece9ecbab5fd15da3c4765b0b3033d049"}
Nov 03 17:17:01.190639 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:01.190600    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9lj8v" event={"ID":"88031944-e289-40ee-b002-884805e6bec6","Type":"ContainerStarted","Data":"8c4897da1aa4fdbaeac0628127a9be6f23096465b08bf390ba19a0d69b24e4e7"}
Nov 03 17:17:01.192236 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:01.192198    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq" event={"ID":"b7b688a0-df63-47e1-96c3-8d17aad4f7fc","Type":"ContainerStarted","Data":"76c2ce81b96be95955c0244f58873ba1291dc042e7a6c5e6611b23fa856f4031"}
Nov 03 17:17:01.192362 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:01.192257    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq" event={"ID":"b7b688a0-df63-47e1-96c3-8d17aad4f7fc","Type":"ContainerStarted","Data":"4a0bcc026b442a9a2df5b7efffdfec27763c1d4c64f941f08e97193bfa22ab20"}
Nov 03 17:17:01.192362 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:01.192331    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:01.193399 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:01.193376    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-l5d49" event={"ID":"2dbbea70-2a0b-45f8-9c29-58bdfff76d74","Type":"ContainerStarted","Data":"688207cbbd7d5d5ac0675e642ca5dfe0ad40a059c441875beefe480023e10110"}
Nov 03 17:17:01.424314 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:01.424253    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq" podStartSLOduration=1.424214822 podStartE2EDuration="1.424214822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:17:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:17:01.423524896 +0000 UTC m=+21.624862950" watchObservedRunningTime="2026-11-03 17:17:01.424214822 +0000 UTC m=+21.625552886"
Nov 03 17:17:02.140430 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:02.140388    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j4bd8"
Nov 03 17:17:03.204757 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:03.204716    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-v77q9" event={"ID":"67f75b9b-4d90-46f1-942f-e3fb290e46d3","Type":"ContainerStarted","Data":"baab541bd6ca26253f21db988924357a1f4489b89a355454b8c17a606329d6e9"}
Nov 03 17:17:03.205187 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:03.204939    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-v77q9"
Nov 03 17:17:03.209709 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:03.209685    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-v77q9"
Nov 03 17:17:03.428052 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:03.427996    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-v77q9" podStartSLOduration=1.952410204 podStartE2EDuration="3.427980579s" totalImagesPullingTime="1.475570375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:17:03.315686277 +0000 UTC m=+23.517024328" watchObservedRunningTime="2026-11-03 17:17:03.427980579 +0000 UTC m=+23.629318631"
Nov 03 17:17:04.957596 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:04.957555    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-95446"]
Nov 03 17:17:04.986393 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:04.986363    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446"
Nov 03 17:17:05.015909 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.015880    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-95446"]
Nov 03 17:17:05.047974 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.047941    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8hjb\" (UniqueName: \"kubernetes.io/projected/414225d4-1413-466a-ac33-934261621dfc-kube-api-access-b8hjb\") pod \"prometheus-operator-9cd89b74c-95446\" (UID: \"414225d4-1413-466a-ac33-934261621dfc\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446"
Nov 03 17:17:05.048144 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.047999    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/414225d4-1413-466a-ac33-934261621dfc-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-95446\" (UID: \"414225d4-1413-466a-ac33-934261621dfc\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446"
Nov 03 17:17:05.048144 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.048101    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/414225d4-1413-466a-ac33-934261621dfc-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-95446\" (UID: \"414225d4-1413-466a-ac33-934261621dfc\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446"
Nov 03 17:17:05.048144 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.048125    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/414225d4-1413-466a-ac33-934261621dfc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-95446\" (UID: \"414225d4-1413-466a-ac33-934261621dfc\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446"
Nov 03 17:17:05.084116 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.084080    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7nrcx\""
Nov 03 17:17:05.084380 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.084360    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Nov 03 17:17:05.084380 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.084363    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Nov 03 17:17:05.084528 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.084390    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 03 17:17:05.149287 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.149250    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/414225d4-1413-466a-ac33-934261621dfc-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-95446\" (UID: \"414225d4-1413-466a-ac33-934261621dfc\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446"
Nov 03 17:17:05.149455 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.149309    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/414225d4-1413-466a-ac33-934261621dfc-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-95446\" (UID: \"414225d4-1413-466a-ac33-934261621dfc\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446"
Nov 03 17:17:05.149455 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.149345    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/414225d4-1413-466a-ac33-934261621dfc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-95446\" (UID: \"414225d4-1413-466a-ac33-934261621dfc\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446"
Nov 03 17:17:05.149455 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.149408    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8hjb\" (UniqueName: \"kubernetes.io/projected/414225d4-1413-466a-ac33-934261621dfc-kube-api-access-b8hjb\") pod \"prometheus-operator-9cd89b74c-95446\" (UID: \"414225d4-1413-466a-ac33-934261621dfc\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446"
Nov 03 17:17:05.150404 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.150376    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/414225d4-1413-466a-ac33-934261621dfc-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-95446\" (UID: \"414225d4-1413-466a-ac33-934261621dfc\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446"
Nov 03 17:17:05.152445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.152419    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/414225d4-1413-466a-ac33-934261621dfc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-95446\" (UID: \"414225d4-1413-466a-ac33-934261621dfc\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446"
Nov 03 17:17:05.152536 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.152450    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/414225d4-1413-466a-ac33-934261621dfc-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-95446\" (UID: \"414225d4-1413-466a-ac33-934261621dfc\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446"
Nov 03 17:17:05.208588 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.208515    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8hjb\" (UniqueName: \"kubernetes.io/projected/414225d4-1413-466a-ac33-934261621dfc-kube-api-access-b8hjb\") pod \"prometheus-operator-9cd89b74c-95446\" (UID: \"414225d4-1413-466a-ac33-934261621dfc\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446"
Nov 03 17:17:05.333073 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.333041    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446"
Nov 03 17:17:05.453045 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.453006    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-754c6b697d-t4h9m"]
Nov 03 17:17:05.479970 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.479894    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.517624 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.516114    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-754c6b697d-t4h9m"]
Nov 03 17:17:05.532874 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.532832    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Nov 03 17:17:05.532874 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.532872    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9495t\""
Nov 03 17:17:05.533089 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.532942    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Nov 03 17:17:05.533496 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.533474    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Nov 03 17:17:05.533496 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.533479    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Nov 03 17:17:05.533815 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.533796    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Nov 03 17:17:05.552322 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.552291    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db9b617f-3f4a-4994-8cac-c44cad764911-console-oauth-config\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.552492 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.552448    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-oauth-serving-cert\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.552545 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.552499    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgf7t\" (UniqueName: \"kubernetes.io/projected/db9b617f-3f4a-4994-8cac-c44cad764911-kube-api-access-bgf7t\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.552582 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.552566    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-service-ca\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.552661 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.552638    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db9b617f-3f4a-4994-8cac-c44cad764911-tmp\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.552717 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.552692    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db9b617f-3f4a-4994-8cac-c44cad764911-console-serving-cert\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.552773 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.552715    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-console-config\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.653747 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.653705    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgf7t\" (UniqueName: \"kubernetes.io/projected/db9b617f-3f4a-4994-8cac-c44cad764911-kube-api-access-bgf7t\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.653926 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.653756    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-service-ca\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.653926 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.653804    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db9b617f-3f4a-4994-8cac-c44cad764911-tmp\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.653926 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.653838    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db9b617f-3f4a-4994-8cac-c44cad764911-console-serving-cert\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.653926 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.653856    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-console-config\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.653926 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.653890    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db9b617f-3f4a-4994-8cac-c44cad764911-console-oauth-config\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.654137 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.653970    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-oauth-serving-cert\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.654342 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.654320    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db9b617f-3f4a-4994-8cac-c44cad764911-tmp\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.654959 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.654862    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-console-config\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.654959 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.654893    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-service-ca\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.655116 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.655088    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-oauth-serving-cert\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.656606 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.656583    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db9b617f-3f4a-4994-8cac-c44cad764911-console-serving-cert\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.656707 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.656613    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db9b617f-3f4a-4994-8cac-c44cad764911-console-oauth-config\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.716491 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.716455    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgf7t\" (UniqueName: \"kubernetes.io/projected/db9b617f-3f4a-4994-8cac-c44cad764911-kube-api-access-bgf7t\") pod \"console-754c6b697d-t4h9m\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") " pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:05.726994 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.726964    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-95446"]
Nov 03 17:17:05.733416 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:17:05.733382    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod414225d4_1413_466a_ac33_934261621dfc.slice/crio-c92281f7d8bf97f8ce3041ca754415a65afdecfeeefa0ddd7699df1c497b91ae WatchSource:0}: Error finding container c92281f7d8bf97f8ce3041ca754415a65afdecfeeefa0ddd7699df1c497b91ae: Status 404 returned error can't find the container with id c92281f7d8bf97f8ce3041ca754415a65afdecfeeefa0ddd7699df1c497b91ae
Nov 03 17:17:05.809193 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:05.809156    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:06.204785 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:06.204746    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-754c6b697d-t4h9m"]
Nov 03 17:17:06.212420 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:17:06.212359    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9b617f_3f4a_4994_8cac_c44cad764911.slice/crio-bf90e703d8beb05001dff3c99668bd1debc2990fc145d7bdc1d29af953a24bff WatchSource:0}: Error finding container bf90e703d8beb05001dff3c99668bd1debc2990fc145d7bdc1d29af953a24bff: Status 404 returned error can't find the container with id bf90e703d8beb05001dff3c99668bd1debc2990fc145d7bdc1d29af953a24bff
Nov 03 17:17:06.221623 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:06.221597    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446" event={"ID":"414225d4-1413-466a-ac33-934261621dfc","Type":"ContainerStarted","Data":"c92281f7d8bf97f8ce3041ca754415a65afdecfeeefa0ddd7699df1c497b91ae"}
Nov 03 17:17:06.222820 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:06.222794    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754c6b697d-t4h9m" event={"ID":"db9b617f-3f4a-4994-8cac-c44cad764911","Type":"ContainerStarted","Data":"bf90e703d8beb05001dff3c99668bd1debc2990fc145d7bdc1d29af953a24bff"}
Nov 03 17:17:07.053319 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:17:07.053286    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:17:09.245494 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:09.245454    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446" event={"ID":"414225d4-1413-466a-ac33-934261621dfc","Type":"ContainerStarted","Data":"859b0accb8126560e0500d126f9b6005ed1e564b1be39313bd131319685527d2"}
Nov 03 17:17:09.245955 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:09.245521    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446" event={"ID":"414225d4-1413-466a-ac33-934261621dfc","Type":"ContainerStarted","Data":"da046335032e83e21d70db9403341b092474a3c70d1319be1acf65b5f336b827"}
Nov 03 17:17:09.363188 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:09.361805    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-95446" podStartSLOduration=2.967159686 podStartE2EDuration="5.36178869s" totalImagesPullingTime="2.394629004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:17:09.361392574 +0000 UTC m=+29.562730628" watchObservedRunningTime="2026-11-03 17:17:09.36178869 +0000 UTC m=+29.563126742"
Nov 03 17:17:10.350344 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:10.350312    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jjqzh"
Nov 03 17:17:11.257309 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:11.257266    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754c6b697d-t4h9m" event={"ID":"db9b617f-3f4a-4994-8cac-c44cad764911","Type":"ContainerStarted","Data":"2f52dc50c342997b40a5b7ceb89b48af745cdc2bc109725bef54c0f569d24956"}
Nov 03 17:17:11.394766 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:11.394705    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-754c6b697d-t4h9m" podStartSLOduration=2.295650763 podStartE2EDuration="6.394689842s" totalImagesPullingTime="4.099039079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:17:11.393690431 +0000 UTC m=+31.595028507" watchObservedRunningTime="2026-11-03 17:17:11.394689842 +0000 UTC m=+31.596027884"
Nov 03 17:17:12.774351 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:12.774316    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t4x87"]
Nov 03 17:17:12.807403 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:12.807369    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:12.872708 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:12.872673    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 03 17:17:12.921901 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:12.921856    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 03 17:17:12.921901 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:12.921863    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 03 17:17:12.921901 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:12.921912    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4vh8j\""
Nov 03 17:17:12.925914 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:12.925886    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91f43bc3-b6fc-4222-acee-6932941b6cb9-metrics-client-ca\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:12.926075 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:12.925930    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91f43bc3-b6fc-4222-acee-6932941b6cb9-node-exporter-wtmp\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:12.926142 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:12.926068    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91f43bc3-b6fc-4222-acee-6932941b6cb9-node-exporter-tls\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:12.926142 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:12.926108    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zndp\" (UniqueName: \"kubernetes.io/projected/91f43bc3-b6fc-4222-acee-6932941b6cb9-kube-api-access-8zndp\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:12.926259 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:12.926196    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91f43bc3-b6fc-4222-acee-6932941b6cb9-node-exporter-textfile\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:12.926325 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:12.926272    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91f43bc3-b6fc-4222-acee-6932941b6cb9-sys\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:12.926325 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:12.926297    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91f43bc3-b6fc-4222-acee-6932941b6cb9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:12.926410 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:12.926355    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91f43bc3-b6fc-4222-acee-6932941b6cb9-root\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:12.926465 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:12.926416    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91f43bc3-b6fc-4222-acee-6932941b6cb9-node-exporter-accelerators-collector-config\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.027553 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.027457    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91f43bc3-b6fc-4222-acee-6932941b6cb9-sys\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.027553 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.027507    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91f43bc3-b6fc-4222-acee-6932941b6cb9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.027553 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.027539    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91f43bc3-b6fc-4222-acee-6932941b6cb9-root\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.027847 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.027560    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91f43bc3-b6fc-4222-acee-6932941b6cb9-node-exporter-accelerators-collector-config\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.027847 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.027599    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91f43bc3-b6fc-4222-acee-6932941b6cb9-sys\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.027847 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.027620    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91f43bc3-b6fc-4222-acee-6932941b6cb9-metrics-client-ca\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.027847 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.027614    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91f43bc3-b6fc-4222-acee-6932941b6cb9-root\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.027847 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.027687    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91f43bc3-b6fc-4222-acee-6932941b6cb9-node-exporter-wtmp\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.027847 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.027734    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91f43bc3-b6fc-4222-acee-6932941b6cb9-node-exporter-tls\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.027847 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.027760    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zndp\" (UniqueName: \"kubernetes.io/projected/91f43bc3-b6fc-4222-acee-6932941b6cb9-kube-api-access-8zndp\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.027847 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.027793    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91f43bc3-b6fc-4222-acee-6932941b6cb9-node-exporter-textfile\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.028217 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.028108    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91f43bc3-b6fc-4222-acee-6932941b6cb9-node-exporter-wtmp\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.028327 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.028277    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91f43bc3-b6fc-4222-acee-6932941b6cb9-node-exporter-accelerators-collector-config\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.028387 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.028341    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91f43bc3-b6fc-4222-acee-6932941b6cb9-metrics-client-ca\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.028497 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.028477    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91f43bc3-b6fc-4222-acee-6932941b6cb9-node-exporter-textfile\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.030830 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.030803    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91f43bc3-b6fc-4222-acee-6932941b6cb9-node-exporter-tls\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.030957 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.030811    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91f43bc3-b6fc-4222-acee-6932941b6cb9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.087408 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.087378    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zndp\" (UniqueName: \"kubernetes.io/projected/91f43bc3-b6fc-4222-acee-6932941b6cb9-kube-api-access-8zndp\") pod \"node-exporter-t4x87\" (UID: \"91f43bc3-b6fc-4222-acee-6932941b6cb9\") " pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.176462 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.176426    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t4x87"
Nov 03 17:17:13.213146 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:17:13.213100    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f43bc3_b6fc_4222_acee_6932941b6cb9.slice/crio-cd98a907b6c0185928c286ee7724099ecf02d4c4b19957c57da4d0ac81f8b944 WatchSource:0}: Error finding container cd98a907b6c0185928c286ee7724099ecf02d4c4b19957c57da4d0ac81f8b944: Status 404 returned error can't find the container with id cd98a907b6c0185928c286ee7724099ecf02d4c4b19957c57da4d0ac81f8b944
Nov 03 17:17:13.271479 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:13.271432    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t4x87" event={"ID":"91f43bc3-b6fc-4222-acee-6932941b6cb9","Type":"ContainerStarted","Data":"cd98a907b6c0185928c286ee7724099ecf02d4c4b19957c57da4d0ac81f8b944"}
Nov 03 17:17:14.239320 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:14.239279    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s7n7v"
Nov 03 17:17:15.285338 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:15.285295    5021 generic.go:356] "Generic (PLEG): container finished" podID="91f43bc3-b6fc-4222-acee-6932941b6cb9" containerID="62753d6a41bdfe2ff142cddc9a969018e0e6180b42cd75bacaf292b9f44ca5fc" exitCode=0
Nov 03 17:17:15.285798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:15.285368    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t4x87" event={"ID":"91f43bc3-b6fc-4222-acee-6932941b6cb9","Type":"ContainerDied","Data":"62753d6a41bdfe2ff142cddc9a969018e0e6180b42cd75bacaf292b9f44ca5fc"}
Nov 03 17:17:15.809628 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:15.809582    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:15.809847 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:15.809652    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:15.815272 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:15.815245    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:16.293354 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:16.293317    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t4x87" event={"ID":"91f43bc3-b6fc-4222-acee-6932941b6cb9","Type":"ContainerStarted","Data":"b9bdfdc886fcc2a1b973191d433efbc9eaa69509db4db81ec9ce21b6e66a70fe"}
Nov 03 17:17:16.293812 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:16.293380    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t4x87" event={"ID":"91f43bc3-b6fc-4222-acee-6932941b6cb9","Type":"ContainerStarted","Data":"1301c29902269cb4d5f584bf200174fcc04e7ab62b3e12ec5d33fd57c57d7771"}
Nov 03 17:17:16.298675 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:16.298645    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:17:16.409358 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:16.409294    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t4x87" podStartSLOduration=2.803721399 podStartE2EDuration="4.409275681s" totalImagesPullingTime="1.526015317s" totalInitContainerRuntime="79.538965ms" isStatefulPod=true podCreationTimestamp="2026-11-03 17:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:17:16.407877867 +0000 UTC m=+36.609215919" watchObservedRunningTime="2026-11-03 17:17:16.409275681 +0000 UTC m=+36.610613735"
Nov 03 17:17:19.175456 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:19.175423    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:17:19.312668 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:19.311157    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-l5d49" event={"ID":"2dbbea70-2a0b-45f8-9c29-58bdfff76d74","Type":"ContainerStarted","Data":"dab7543414df214ceb82db22e6080e166500ea6604faea7b114a0e8aab0afe87"}
Nov 03 17:17:19.312668 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:19.311346    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-l5d49"
Nov 03 17:17:19.331877 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:19.331843    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-l5d49"
Nov 03 17:17:19.481346 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:19.481248    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-l5d49" podStartSLOduration=1.9087032160000001 podStartE2EDuration="19.481217063s" totalImagesPullingTime="17.572513847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:17:19.479825403 +0000 UTC m=+39.681163455" watchObservedRunningTime="2026-11-03 17:17:19.481217063 +0000 UTC m=+39.682555116"
Nov 03 17:17:20.189539 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:20.189505    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:17:22.204353 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:22.204320    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-ccfc97f7b-6nkbq"
Nov 03 17:17:22.443486 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:22.443341    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5599885c48-cn2ff"]
Nov 03 17:17:25.208810 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.208746    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq" podUID="836fc8fa-ebbb-4836-b453-2b9be6db8452" containerName="registry" containerID="cri-o://17c198ccb8f065661db08c58ab7fa4292d9315699756060c2496cfed7e599fd0" gracePeriod=30
Nov 03 17:17:25.343679 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.343646    5021 generic.go:356] "Generic (PLEG): container finished" podID="836fc8fa-ebbb-4836-b453-2b9be6db8452" containerID="17c198ccb8f065661db08c58ab7fa4292d9315699756060c2496cfed7e599fd0" exitCode=0
Nov 03 17:17:25.343849 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.343720    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq" event={"ID":"836fc8fa-ebbb-4836-b453-2b9be6db8452","Type":"ContainerDied","Data":"17c198ccb8f065661db08c58ab7fa4292d9315699756060c2496cfed7e599fd0"}
Nov 03 17:17:25.541051 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.541015    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:17:25.666558 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.666517    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-kube-api-access-2zkk6\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-kube-api-access-2zkk6\") pod \"836fc8fa-ebbb-4836-b453-2b9be6db8452\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") "
Nov 03 17:17:25.666742 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.666689    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-image-registry-private-configuration\") pod \"836fc8fa-ebbb-4836-b453-2b9be6db8452\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") "
Nov 03 17:17:25.666742 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.666720    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls\") pod \"836fc8fa-ebbb-4836-b453-2b9be6db8452\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") "
Nov 03 17:17:25.666850 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.666758    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-installation-pull-secrets\") pod \"836fc8fa-ebbb-4836-b453-2b9be6db8452\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") "
Nov 03 17:17:25.666850 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.666834    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/836fc8fa-ebbb-4836-b453-2b9be6db8452-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/836fc8fa-ebbb-4836-b453-2b9be6db8452-ca-trust-extracted\") pod \"836fc8fa-ebbb-4836-b453-2b9be6db8452\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") "
Nov 03 17:17:25.666949 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.666874    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-trusted-ca\") pod \"836fc8fa-ebbb-4836-b453-2b9be6db8452\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") "
Nov 03 17:17:25.666949 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.666911    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-certificates\") pod \"836fc8fa-ebbb-4836-b453-2b9be6db8452\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") "
Nov 03 17:17:25.666949 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.666943    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-bound-sa-token\") pod \"836fc8fa-ebbb-4836-b453-2b9be6db8452\" (UID: \"836fc8fa-ebbb-4836-b453-2b9be6db8452\") "
Nov 03 17:17:25.667851 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.667559    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-trusted-ca" pod "836fc8fa-ebbb-4836-b453-2b9be6db8452" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:17:25.667851 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.667724    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-certificates" pod "836fc8fa-ebbb-4836-b453-2b9be6db8452" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:17:25.669674 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.669436    5021 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-trusted-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:17:25.669674 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.669466    5021 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-certificates\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:17:25.670089 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.670058    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-installation-pull-secrets" pod "836fc8fa-ebbb-4836-b453-2b9be6db8452" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:17:25.670311 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.670176    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-kube-api-access-2zkk6" pod "836fc8fa-ebbb-4836-b453-2b9be6db8452" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452"). InnerVolumeSpecName "kube-api-access-2zkk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:17:25.670311 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.670273    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-image-registry-private-configuration" pod "836fc8fa-ebbb-4836-b453-2b9be6db8452" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:17:25.675978 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.675946    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls" pod "836fc8fa-ebbb-4836-b453-2b9be6db8452" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:17:25.677916 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.677876    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/836fc8fa-ebbb-4836-b453-2b9be6db8452-ca-trust-extracted" pod "836fc8fa-ebbb-4836-b453-2b9be6db8452" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:17:25.680084 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.680049    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-bound-sa-token" pod "836fc8fa-ebbb-4836-b453-2b9be6db8452" (UID: "836fc8fa-ebbb-4836-b453-2b9be6db8452"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:17:25.770673 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.770625    5021 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-installation-pull-secrets\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:17:25.770673 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.770663    5021 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/836fc8fa-ebbb-4836-b453-2b9be6db8452-ca-trust-extracted\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:17:25.770673 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.770678    5021 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-bound-sa-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:17:25.770932 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.770695    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zkk6\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-kube-api-access-2zkk6\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:17:25.770932 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.770709    5021 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/836fc8fa-ebbb-4836-b453-2b9be6db8452-image-registry-private-configuration\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:17:25.770932 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:25.770722    5021 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/836fc8fa-ebbb-4836-b453-2b9be6db8452-registry-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:17:26.350210 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:26.350172    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq" event={"ID":"836fc8fa-ebbb-4836-b453-2b9be6db8452","Type":"ContainerDied","Data":"3e48f1f0c54b1b125da96ea7ac9a277a4ba8e21208c356960ad1eb3e2e4e72fb"}
Nov 03 17:17:26.350674 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:26.350259    5021 scope.go:122] "RemoveContainer" containerID="17c198ccb8f065661db08c58ab7fa4292d9315699756060c2496cfed7e599fd0"
Nov 03 17:17:26.350674 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:26.350181    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c98dd6d65-rjtsq"
Nov 03 17:17:26.558485 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:26.558453    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c98dd6d65-rjtsq"]
Nov 03 17:17:26.606377 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:26.606305    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c98dd6d65-rjtsq"]
Nov 03 17:17:28.001342 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:28.001309    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="836fc8fa-ebbb-4836-b453-2b9be6db8452" path="/var/lib/kubelet/pods/836fc8fa-ebbb-4836-b453-2b9be6db8452/volumes"
Nov 03 17:17:35.383581 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:35.383549    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-754c6b697d-t4h9m"]
Nov 03 17:17:37.045062 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:17:37.045018    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:17:46.435486 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:46.435450    5021 generic.go:356] "Generic (PLEG): container finished" podID="7ba6ecd5-1d02-4433-b245-1c957827467e" containerID="4b5687d235e652dc6f51b789d0d6158c4588688802f98aab42492033d1696fd6" exitCode=0
Nov 03 17:17:46.435985 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:46.435538    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2" event={"ID":"7ba6ecd5-1d02-4433-b245-1c957827467e","Type":"ContainerDied","Data":"4b5687d235e652dc6f51b789d0d6158c4588688802f98aab42492033d1696fd6"}
Nov 03 17:17:46.435985 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:46.435833    5021 scope.go:122] "RemoveContainer" containerID="4b5687d235e652dc6f51b789d0d6158c4588688802f98aab42492033d1696fd6"
Nov 03 17:17:47.441725 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.441690    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-btzt2" event={"ID":"7ba6ecd5-1d02-4433-b245-1c957827467e","Type":"ContainerStarted","Data":"6708a24dd7488aef2a50578918616e00d02e54071651cfcffc655c6406d3c0c8"}
Nov 03 17:17:47.472331 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.472275    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5599885c48-cn2ff" podUID="10a6a241-8eef-4bf1-b609-dd71d2042646" containerName="registry" containerID="cri-o://60198dee04f726e6e71e78695f69707fd5005bdefc0b7f78e04550296265db76" gracePeriod=30
Nov 03 17:17:47.750197 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.750172    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:17:47.862445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.862407    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-kube-api-access-h6q9p\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-kube-api-access-h6q9p\") pod \"10a6a241-8eef-4bf1-b609-dd71d2042646\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") "
Nov 03 17:17:47.862623 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.862473    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-bound-sa-token\") pod \"10a6a241-8eef-4bf1-b609-dd71d2042646\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") "
Nov 03 17:17:47.862623 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.862512    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls\") pod \"10a6a241-8eef-4bf1-b609-dd71d2042646\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") "
Nov 03 17:17:47.862623 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.862557    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-installation-pull-secrets\") pod \"10a6a241-8eef-4bf1-b609-dd71d2042646\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") "
Nov 03 17:17:47.862623 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.862585    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-certificates\") pod \"10a6a241-8eef-4bf1-b609-dd71d2042646\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") "
Nov 03 17:17:47.862849 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.862724    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-trusted-ca\") pod \"10a6a241-8eef-4bf1-b609-dd71d2042646\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") "
Nov 03 17:17:47.862849 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.862796    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-image-registry-private-configuration\") pod \"10a6a241-8eef-4bf1-b609-dd71d2042646\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") "
Nov 03 17:17:47.862949 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.862864    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/10a6a241-8eef-4bf1-b609-dd71d2042646-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10a6a241-8eef-4bf1-b609-dd71d2042646-ca-trust-extracted\") pod \"10a6a241-8eef-4bf1-b609-dd71d2042646\" (UID: \"10a6a241-8eef-4bf1-b609-dd71d2042646\") "
Nov 03 17:17:47.863131 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.863099    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-certificates" pod "10a6a241-8eef-4bf1-b609-dd71d2042646" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:17:47.863361 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.863296    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-trusted-ca" pod "10a6a241-8eef-4bf1-b609-dd71d2042646" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:17:47.865128 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.865085    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-kube-api-access-h6q9p" pod "10a6a241-8eef-4bf1-b609-dd71d2042646" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646"). InnerVolumeSpecName "kube-api-access-h6q9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:17:47.865420 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.865392    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-bound-sa-token" pod "10a6a241-8eef-4bf1-b609-dd71d2042646" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:17:47.865420 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.865403    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls" pod "10a6a241-8eef-4bf1-b609-dd71d2042646" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:17:47.865420 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.865424    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-installation-pull-secrets" pod "10a6a241-8eef-4bf1-b609-dd71d2042646" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:17:47.866000 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.865475    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-image-registry-private-configuration" pod "10a6a241-8eef-4bf1-b609-dd71d2042646" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:17:47.870691 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.870663    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10a6a241-8eef-4bf1-b609-dd71d2042646-ca-trust-extracted" pod "10a6a241-8eef-4bf1-b609-dd71d2042646" (UID: "10a6a241-8eef-4bf1-b609-dd71d2042646"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:17:47.963648 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.963612    5021 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-image-registry-private-configuration\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:17:47.963648 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.963646    5021 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10a6a241-8eef-4bf1-b609-dd71d2042646-ca-trust-extracted\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:17:47.963648 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.963657    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6q9p\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-kube-api-access-h6q9p\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:17:47.963887 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.963668    5021 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-bound-sa-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:17:47.963887 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.963678    5021 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:17:47.963887 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.963687    5021 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10a6a241-8eef-4bf1-b609-dd71d2042646-installation-pull-secrets\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:17:47.963887 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.963695    5021 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-registry-certificates\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:17:47.963887 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:47.963707    5021 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10a6a241-8eef-4bf1-b609-dd71d2042646-trusted-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:17:48.446546 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:48.446464    5021 generic.go:356] "Generic (PLEG): container finished" podID="10a6a241-8eef-4bf1-b609-dd71d2042646" containerID="60198dee04f726e6e71e78695f69707fd5005bdefc0b7f78e04550296265db76" exitCode=0
Nov 03 17:17:48.446546 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:48.446507    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5599885c48-cn2ff"
Nov 03 17:17:48.447054 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:48.446553    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5599885c48-cn2ff" event={"ID":"10a6a241-8eef-4bf1-b609-dd71d2042646","Type":"ContainerDied","Data":"60198dee04f726e6e71e78695f69707fd5005bdefc0b7f78e04550296265db76"}
Nov 03 17:17:48.447054 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:48.446613    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5599885c48-cn2ff" event={"ID":"10a6a241-8eef-4bf1-b609-dd71d2042646","Type":"ContainerDied","Data":"e55350805b35fa559f3683788b4e314d52a85d1ee1ac65ba809d0e437fae403c"}
Nov 03 17:17:48.447054 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:48.446641    5021 scope.go:122] "RemoveContainer" containerID="60198dee04f726e6e71e78695f69707fd5005bdefc0b7f78e04550296265db76"
Nov 03 17:17:48.454945 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:48.454920    5021 scope.go:122] "RemoveContainer" containerID="60198dee04f726e6e71e78695f69707fd5005bdefc0b7f78e04550296265db76"
Nov 03 17:17:48.455265 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:17:48.455241    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60198dee04f726e6e71e78695f69707fd5005bdefc0b7f78e04550296265db76\": container with ID starting with 60198dee04f726e6e71e78695f69707fd5005bdefc0b7f78e04550296265db76 not found: ID does not exist" containerID="60198dee04f726e6e71e78695f69707fd5005bdefc0b7f78e04550296265db76"
Nov 03 17:17:48.455324 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:48.455279    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60198dee04f726e6e71e78695f69707fd5005bdefc0b7f78e04550296265db76"} err="failed to get container status \"60198dee04f726e6e71e78695f69707fd5005bdefc0b7f78e04550296265db76\": rpc error: code = NotFound desc = could not find container \"60198dee04f726e6e71e78695f69707fd5005bdefc0b7f78e04550296265db76\": container with ID starting with 60198dee04f726e6e71e78695f69707fd5005bdefc0b7f78e04550296265db76 not found: ID does not exist"
Nov 03 17:17:48.655561 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:48.655531    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5599885c48-cn2ff"]
Nov 03 17:17:48.702834 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:48.702755    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5599885c48-cn2ff"]
Nov 03 17:17:50.000804 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:17:50.000774    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="10a6a241-8eef-4bf1-b609-dd71d2042646" path="/var/lib/kubelet/pods/10a6a241-8eef-4bf1-b609-dd71d2042646/volumes"
Nov 03 17:18:00.404440 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.404380    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-754c6b697d-t4h9m" podUID="db9b617f-3f4a-4994-8cac-c44cad764911" containerName="console" containerID="cri-o://2f52dc50c342997b40a5b7ceb89b48af745cdc2bc109725bef54c0f569d24956" gracePeriod=15
Nov 03 17:18:00.441318 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:18:00.441285    5021 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9b617f_3f4a_4994_8cac_c44cad764911.slice/crio-2f52dc50c342997b40a5b7ceb89b48af745cdc2bc109725bef54c0f569d24956.scope\": RecentStats: unable to find data in memory cache]"
Nov 03 17:18:00.695553 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.695523    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:18:00.775959 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.775931    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db9b617f-3f4a-4994-8cac-c44cad764911-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db9b617f-3f4a-4994-8cac-c44cad764911-console-oauth-config\") pod \"db9b617f-3f4a-4994-8cac-c44cad764911\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") "
Nov 03 17:18:00.776092 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.775984    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-console-config\" (UniqueName: \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-console-config\") pod \"db9b617f-3f4a-4994-8cac-c44cad764911\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") "
Nov 03 17:18:00.776092 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.776013    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-service-ca\" (UniqueName: \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-service-ca\") pod \"db9b617f-3f4a-4994-8cac-c44cad764911\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") "
Nov 03 17:18:00.776092 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.776070    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db9b617f-3f4a-4994-8cac-c44cad764911-kube-api-access-bgf7t\" (UniqueName: \"kubernetes.io/projected/db9b617f-3f4a-4994-8cac-c44cad764911-kube-api-access-bgf7t\") pod \"db9b617f-3f4a-4994-8cac-c44cad764911\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") "
Nov 03 17:18:00.776270 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.776105    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db9b617f-3f4a-4994-8cac-c44cad764911-tmp\" (UniqueName: \"kubernetes.io/empty-dir/db9b617f-3f4a-4994-8cac-c44cad764911-tmp\") pod \"db9b617f-3f4a-4994-8cac-c44cad764911\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") "
Nov 03 17:18:00.776270 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.776157    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-oauth-serving-cert\") pod \"db9b617f-3f4a-4994-8cac-c44cad764911\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") "
Nov 03 17:18:00.776270 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.776185    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db9b617f-3f4a-4994-8cac-c44cad764911-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db9b617f-3f4a-4994-8cac-c44cad764911-console-serving-cert\") pod \"db9b617f-3f4a-4994-8cac-c44cad764911\" (UID: \"db9b617f-3f4a-4994-8cac-c44cad764911\") "
Nov 03 17:18:00.776489 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.776457    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db9b617f-3f4a-4994-8cac-c44cad764911-tmp" pod "db9b617f-3f4a-4994-8cac-c44cad764911" (UID: "db9b617f-3f4a-4994-8cac-c44cad764911"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:18:00.776580 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.776537    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-console-config" pod "db9b617f-3f4a-4994-8cac-c44cad764911" (UID: "db9b617f-3f4a-4994-8cac-c44cad764911"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:18:00.776580 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.776549    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-service-ca" pod "db9b617f-3f4a-4994-8cac-c44cad764911" (UID: "db9b617f-3f4a-4994-8cac-c44cad764911"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:18:00.776580 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.776561    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-oauth-serving-cert" pod "db9b617f-3f4a-4994-8cac-c44cad764911" (UID: "db9b617f-3f4a-4994-8cac-c44cad764911"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:18:00.778189 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.778166    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db9b617f-3f4a-4994-8cac-c44cad764911-console-oauth-config" pod "db9b617f-3f4a-4994-8cac-c44cad764911" (UID: "db9b617f-3f4a-4994-8cac-c44cad764911"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:18:00.778334 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.778203    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db9b617f-3f4a-4994-8cac-c44cad764911-kube-api-access-bgf7t" pod "db9b617f-3f4a-4994-8cac-c44cad764911" (UID: "db9b617f-3f4a-4994-8cac-c44cad764911"). InnerVolumeSpecName "kube-api-access-bgf7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:18:00.778462 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.778438    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db9b617f-3f4a-4994-8cac-c44cad764911-console-serving-cert" pod "db9b617f-3f4a-4994-8cac-c44cad764911" (UID: "db9b617f-3f4a-4994-8cac-c44cad764911"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:18:00.877696 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.877663    5021 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-console-config\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:18:00.877696 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.877692    5021 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:18:00.877696 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.877704    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgf7t\" (UniqueName: \"kubernetes.io/projected/db9b617f-3f4a-4994-8cac-c44cad764911-kube-api-access-bgf7t\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:18:00.877939 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.877714    5021 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db9b617f-3f4a-4994-8cac-c44cad764911-tmp\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:18:00.877939 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.877724    5021 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db9b617f-3f4a-4994-8cac-c44cad764911-oauth-serving-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:18:00.877939 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.877732    5021 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db9b617f-3f4a-4994-8cac-c44cad764911-console-serving-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:18:00.877939 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:00.877741    5021 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db9b617f-3f4a-4994-8cac-c44cad764911-console-oauth-config\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:18:01.507097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:01.507067    5021 generic.go:356] "Generic (PLEG): container finished" podID="8ea83f1f-61e7-4236-a5e7-08c079de313b" containerID="5bb983af065c160c0033dfe3b49516a1192f229f81564526e15a0092f9dfbdbc" exitCode=0
Nov 03 17:18:01.507637 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:01.507146    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-vsdc5" event={"ID":"8ea83f1f-61e7-4236-a5e7-08c079de313b","Type":"ContainerDied","Data":"5bb983af065c160c0033dfe3b49516a1192f229f81564526e15a0092f9dfbdbc"}
Nov 03 17:18:01.507637 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:01.507583    5021 scope.go:122] "RemoveContainer" containerID="5bb983af065c160c0033dfe3b49516a1192f229f81564526e15a0092f9dfbdbc"
Nov 03 17:18:01.508524 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:01.508504    5021 generic.go:356] "Generic (PLEG): container finished" podID="db9b617f-3f4a-4994-8cac-c44cad764911" containerID="2f52dc50c342997b40a5b7ceb89b48af745cdc2bc109725bef54c0f569d24956" exitCode=0
Nov 03 17:18:01.508592 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:01.508552    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754c6b697d-t4h9m" event={"ID":"db9b617f-3f4a-4994-8cac-c44cad764911","Type":"ContainerDied","Data":"2f52dc50c342997b40a5b7ceb89b48af745cdc2bc109725bef54c0f569d24956"}
Nov 03 17:18:01.508636 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:01.508592    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754c6b697d-t4h9m" event={"ID":"db9b617f-3f4a-4994-8cac-c44cad764911","Type":"ContainerDied","Data":"bf90e703d8beb05001dff3c99668bd1debc2990fc145d7bdc1d29af953a24bff"}
Nov 03 17:18:01.508636 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:01.508612    5021 scope.go:122] "RemoveContainer" containerID="2f52dc50c342997b40a5b7ceb89b48af745cdc2bc109725bef54c0f569d24956"
Nov 03 17:18:01.508636 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:01.508620    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754c6b697d-t4h9m"
Nov 03 17:18:01.522550 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:01.522527    5021 scope.go:122] "RemoveContainer" containerID="2f52dc50c342997b40a5b7ceb89b48af745cdc2bc109725bef54c0f569d24956"
Nov 03 17:18:01.522904 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:18:01.522886    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f52dc50c342997b40a5b7ceb89b48af745cdc2bc109725bef54c0f569d24956\": container with ID starting with 2f52dc50c342997b40a5b7ceb89b48af745cdc2bc109725bef54c0f569d24956 not found: ID does not exist" containerID="2f52dc50c342997b40a5b7ceb89b48af745cdc2bc109725bef54c0f569d24956"
Nov 03 17:18:01.522988 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:01.522913    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f52dc50c342997b40a5b7ceb89b48af745cdc2bc109725bef54c0f569d24956"} err="failed to get container status \"2f52dc50c342997b40a5b7ceb89b48af745cdc2bc109725bef54c0f569d24956\": rpc error: code = NotFound desc = could not find container \"2f52dc50c342997b40a5b7ceb89b48af745cdc2bc109725bef54c0f569d24956\": container with ID starting with 2f52dc50c342997b40a5b7ceb89b48af745cdc2bc109725bef54c0f569d24956 not found: ID does not exist"
Nov 03 17:18:01.727590 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:01.727561    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-754c6b697d-t4h9m"]
Nov 03 17:18:01.731978 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:01.731952    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-754c6b697d-t4h9m"]
Nov 03 17:18:02.000609 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:02.000534    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="db9b617f-3f4a-4994-8cac-c44cad764911" path="/var/lib/kubelet/pods/db9b617f-3f4a-4994-8cac-c44cad764911/volumes"
Nov 03 17:18:02.514317 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:02.514207    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-vsdc5" event={"ID":"8ea83f1f-61e7-4236-a5e7-08c079de313b","Type":"ContainerStarted","Data":"765fe77c77dd79b7dd0a5423914ea3fbe6b647ba7b00175dd5a3c1c1fd0cd338"}
Nov 03 17:18:02.555734 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:02.555703    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-vjvw2-sht76"]
Nov 03 17:18:02.555909 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:02.555888    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-vjvw2-sht76" podUID="6e6d73d7-6236-4642-9b4c-74940e54057a" containerName="insights-gathering" containerID="cri-o://04f771462f35fbb1cdb3c927907297731654d1f8dee4fae253a714ce4345453c" gracePeriod=30
Nov 03 17:18:02.863100 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:02.863076    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:18:02.995714 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:02.995683    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-trusted-ca-bundle\") pod \"6e6d73d7-6236-4642-9b4c-74940e54057a\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") "
Nov 03 17:18:02.995897 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:02.995783    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-service-ca-bundle\") pod \"6e6d73d7-6236-4642-9b4c-74940e54057a\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") "
Nov 03 17:18:02.995897 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:02.995824    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e6d73d7-6236-4642-9b4c-74940e54057a-kube-api-access-shlzs\" (UniqueName: \"kubernetes.io/projected/6e6d73d7-6236-4642-9b4c-74940e54057a-kube-api-access-shlzs\") pod \"6e6d73d7-6236-4642-9b4c-74940e54057a\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") "
Nov 03 17:18:02.995897 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:02.995846    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e6d73d7-6236-4642-9b4c-74940e54057a-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6e6d73d7-6236-4642-9b4c-74940e54057a-archives-path\") pod \"6e6d73d7-6236-4642-9b4c-74940e54057a\" (UID: \"6e6d73d7-6236-4642-9b4c-74940e54057a\") "
Nov 03 17:18:02.996162 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:02.996136    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-trusted-ca-bundle" pod "6e6d73d7-6236-4642-9b4c-74940e54057a" (UID: "6e6d73d7-6236-4642-9b4c-74940e54057a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:18:02.996162 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:02.996163    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-service-ca-bundle" pod "6e6d73d7-6236-4642-9b4c-74940e54057a" (UID: "6e6d73d7-6236-4642-9b4c-74940e54057a"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:18:02.996292 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:02.996210    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e6d73d7-6236-4642-9b4c-74940e54057a-archives-path" pod "6e6d73d7-6236-4642-9b4c-74940e54057a" (UID: "6e6d73d7-6236-4642-9b4c-74940e54057a"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:18:02.998188 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:02.998162    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e6d73d7-6236-4642-9b4c-74940e54057a-kube-api-access-shlzs" pod "6e6d73d7-6236-4642-9b4c-74940e54057a" (UID: "6e6d73d7-6236-4642-9b4c-74940e54057a"). InnerVolumeSpecName "kube-api-access-shlzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:18:03.096900 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:03.096821    5021 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-service-ca-bundle\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:18:03.096900 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:03.096851    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shlzs\" (UniqueName: \"kubernetes.io/projected/6e6d73d7-6236-4642-9b4c-74940e54057a-kube-api-access-shlzs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:18:03.096900 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:03.096864    5021 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6e6d73d7-6236-4642-9b4c-74940e54057a-archives-path\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:18:03.096900 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:03.096873    5021 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e6d73d7-6236-4642-9b4c-74940e54057a-trusted-ca-bundle\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:18:03.520071 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:03.520038    5021 generic.go:356] "Generic (PLEG): container finished" podID="6e6d73d7-6236-4642-9b4c-74940e54057a" containerID="04f771462f35fbb1cdb3c927907297731654d1f8dee4fae253a714ce4345453c" exitCode=2
Nov 03 17:18:03.520591 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:03.520098    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vjvw2-sht76"
Nov 03 17:18:03.520591 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:03.520125    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vjvw2-sht76" event={"ID":"6e6d73d7-6236-4642-9b4c-74940e54057a","Type":"ContainerDied","Data":"04f771462f35fbb1cdb3c927907297731654d1f8dee4fae253a714ce4345453c"}
Nov 03 17:18:03.520591 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:03.520191    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vjvw2-sht76" event={"ID":"6e6d73d7-6236-4642-9b4c-74940e54057a","Type":"ContainerDied","Data":"167ca99aaa60a0330071a09ecf9dd7bcdb37b420afb38b9cae7140754b9cb71c"}
Nov 03 17:18:03.520591 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:03.520247    5021 scope.go:122] "RemoveContainer" containerID="04f771462f35fbb1cdb3c927907297731654d1f8dee4fae253a714ce4345453c"
Nov 03 17:18:03.529258 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:03.529213    5021 scope.go:122] "RemoveContainer" containerID="04f771462f35fbb1cdb3c927907297731654d1f8dee4fae253a714ce4345453c"
Nov 03 17:18:03.529531 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:18:03.529512    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04f771462f35fbb1cdb3c927907297731654d1f8dee4fae253a714ce4345453c\": container with ID starting with 04f771462f35fbb1cdb3c927907297731654d1f8dee4fae253a714ce4345453c not found: ID does not exist" containerID="04f771462f35fbb1cdb3c927907297731654d1f8dee4fae253a714ce4345453c"
Nov 03 17:18:03.529599 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:03.529540    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04f771462f35fbb1cdb3c927907297731654d1f8dee4fae253a714ce4345453c"} err="failed to get container status \"04f771462f35fbb1cdb3c927907297731654d1f8dee4fae253a714ce4345453c\": rpc error: code = NotFound desc = could not find container \"04f771462f35fbb1cdb3c927907297731654d1f8dee4fae253a714ce4345453c\": container with ID starting with 04f771462f35fbb1cdb3c927907297731654d1f8dee4fae253a714ce4345453c not found: ID does not exist"
Nov 03 17:18:03.677718 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:03.677683    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-vjvw2-sht76"]
Nov 03 17:18:03.724961 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:03.724928    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-vjvw2-sht76"]
Nov 03 17:18:04.001346 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:04.001271    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6e6d73d7-6236-4642-9b4c-74940e54057a" path="/var/lib/kubelet/pods/6e6d73d7-6236-4642-9b4c-74940e54057a/volumes"
Nov 03 17:18:05.530402 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:05.530356    5021 generic.go:356] "Generic (PLEG): container finished" podID="32072064-dcf7-4c58-a5ef-47eeadb245e5" containerID="d66654416e5fa00a8cae86920a4ccb61dcbb1b9cee082b162af12a92a139547f" exitCode=0
Nov 03 17:18:05.530815 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:05.530424    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2" event={"ID":"32072064-dcf7-4c58-a5ef-47eeadb245e5","Type":"ContainerDied","Data":"d66654416e5fa00a8cae86920a4ccb61dcbb1b9cee082b162af12a92a139547f"}
Nov 03 17:18:05.530815 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:05.530760    5021 scope.go:122] "RemoveContainer" containerID="d66654416e5fa00a8cae86920a4ccb61dcbb1b9cee082b162af12a92a139547f"
Nov 03 17:18:06.536636 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:18:06.536601    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-kscd2" event={"ID":"32072064-dcf7-4c58-a5ef-47eeadb245e5","Type":"ContainerStarted","Data":"b6e747ff8ebbc6a65222bcc82276c3a8eda0aa7979aefa1aae47d4d64a1037a6"}
Nov 03 17:18:07.045361 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:18:07.045329    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:18:37.045067 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:18:37.045026    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:19:07.044877 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:19:07.044795    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:19:37.045407 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:19:37.045362    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:20:07.045049 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:20:07.045005    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:20:37.044990 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:20:37.044957    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:20:37.066221 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.066195    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh"]
Nov 03 17:20:37.066563 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.066548    5021 cpu_manager.go:414] "containerMap: removing container" podUID="db9b617f-3f4a-4994-8cac-c44cad764911" containerName="console"
Nov 03 17:20:37.066604 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.066565    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="db9b617f-3f4a-4994-8cac-c44cad764911" containerName="console"
Nov 03 17:20:37.066604 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.066578    5021 cpu_manager.go:414] "containerMap: removing container" podUID="10a6a241-8eef-4bf1-b609-dd71d2042646" containerName="registry"
Nov 03 17:20:37.066604 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.066583    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="10a6a241-8eef-4bf1-b609-dd71d2042646" containerName="registry"
Nov 03 17:20:37.066604 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.066596    5021 cpu_manager.go:414] "containerMap: removing container" podUID="6e6d73d7-6236-4642-9b4c-74940e54057a" containerName="insights-gathering"
Nov 03 17:20:37.066604 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.066600    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e6d73d7-6236-4642-9b4c-74940e54057a" containerName="insights-gathering"
Nov 03 17:20:37.066752 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.066615    5021 cpu_manager.go:414] "containerMap: removing container" podUID="836fc8fa-ebbb-4836-b453-2b9be6db8452" containerName="registry"
Nov 03 17:20:37.066752 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.066620    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="836fc8fa-ebbb-4836-b453-2b9be6db8452" containerName="registry"
Nov 03 17:20:37.066752 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.066673    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="db9b617f-3f4a-4994-8cac-c44cad764911" containerName="console"
Nov 03 17:20:37.066752 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.066680    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="10a6a241-8eef-4bf1-b609-dd71d2042646" containerName="registry"
Nov 03 17:20:37.066752 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.066687    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="6e6d73d7-6236-4642-9b4c-74940e54057a" containerName="insights-gathering"
Nov 03 17:20:37.066752 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.066695    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="836fc8fa-ebbb-4836-b453-2b9be6db8452" containerName="registry"
Nov 03 17:20:37.069270 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.069248    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh"
Nov 03 17:20:37.132534 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.132503    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Nov 03 17:20:37.159038 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.158993    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f594dcd-0946-4c5f-904c-576029113992-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh\" (UID: \"5f594dcd-0946-4c5f-904c-576029113992\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh"
Nov 03 17:20:37.159038 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.159035    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f594dcd-0946-4c5f-904c-576029113992-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh\" (UID: \"5f594dcd-0946-4c5f-904c-576029113992\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh"
Nov 03 17:20:37.159304 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.159056    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5ksh\" (UniqueName: \"kubernetes.io/projected/5f594dcd-0946-4c5f-904c-576029113992-kube-api-access-z5ksh\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh\" (UID: \"5f594dcd-0946-4c5f-904c-576029113992\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh"
Nov 03 17:20:37.179680 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.179654    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Nov 03 17:20:37.179920 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.179902    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-mqhhw\""
Nov 03 17:20:37.181207 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.181187    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh"]
Nov 03 17:20:37.259844 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.259809    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f594dcd-0946-4c5f-904c-576029113992-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh\" (UID: \"5f594dcd-0946-4c5f-904c-576029113992\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh"
Nov 03 17:20:37.259844 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.259846    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f594dcd-0946-4c5f-904c-576029113992-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh\" (UID: \"5f594dcd-0946-4c5f-904c-576029113992\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh"
Nov 03 17:20:37.260030 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.259869    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5ksh\" (UniqueName: \"kubernetes.io/projected/5f594dcd-0946-4c5f-904c-576029113992-kube-api-access-z5ksh\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh\" (UID: \"5f594dcd-0946-4c5f-904c-576029113992\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh"
Nov 03 17:20:37.260191 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.260172    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f594dcd-0946-4c5f-904c-576029113992-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh\" (UID: \"5f594dcd-0946-4c5f-904c-576029113992\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh"
Nov 03 17:20:37.260248 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.260201    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f594dcd-0946-4c5f-904c-576029113992-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh\" (UID: \"5f594dcd-0946-4c5f-904c-576029113992\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh"
Nov 03 17:20:37.318926 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.318862    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5ksh\" (UniqueName: \"kubernetes.io/projected/5f594dcd-0946-4c5f-904c-576029113992-kube-api-access-z5ksh\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh\" (UID: \"5f594dcd-0946-4c5f-904c-576029113992\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh"
Nov 03 17:20:37.381257 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.381208    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh"
Nov 03 17:20:37.746636 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:37.746558    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh"]
Nov 03 17:20:37.753090 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:20:37.753058    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f594dcd_0946_4c5f_904c_576029113992.slice/crio-14e3f08ff58c283ba483368bc6de15887f66c3939a11cb793ab4fa57612930d1 WatchSource:0}: Error finding container 14e3f08ff58c283ba483368bc6de15887f66c3939a11cb793ab4fa57612930d1: Status 404 returned error can't find the container with id 14e3f08ff58c283ba483368bc6de15887f66c3939a11cb793ab4fa57612930d1
Nov 03 17:20:38.130132 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:38.130095    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh" event={"ID":"5f594dcd-0946-4c5f-904c-576029113992","Type":"ContainerStarted","Data":"14e3f08ff58c283ba483368bc6de15887f66c3939a11cb793ab4fa57612930d1"}
Nov 03 17:20:42.909959 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:42.909916    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6"]
Nov 03 17:20:42.922436 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:42.922405    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6"
Nov 03 17:20:42.967380 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:42.967336    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6"]
Nov 03 17:20:43.013780 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.013749    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-d68mj\""
Nov 03 17:20:43.014925 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.014896    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6"]
Nov 03 17:20:43.016938 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.016910    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/167c3418-6216-4e27-9d9b-02a28493a4d6-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6\" (UID: \"167c3418-6216-4e27-9d9b-02a28493a4d6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6"
Nov 03 17:20:43.017059 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.016964    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/167c3418-6216-4e27-9d9b-02a28493a4d6-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6\" (UID: \"167c3418-6216-4e27-9d9b-02a28493a4d6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6"
Nov 03 17:20:43.017111 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.017083    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5hnm\" (UniqueName: \"kubernetes.io/projected/167c3418-6216-4e27-9d9b-02a28493a4d6-kube-api-access-r5hnm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6\" (UID: \"167c3418-6216-4e27-9d9b-02a28493a4d6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6"
Nov 03 17:20:43.019545 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.019524    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6"
Nov 03 17:20:43.023697 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.023673    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54"]
Nov 03 17:20:43.028185 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.028167    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54"
Nov 03 17:20:43.049677 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.049652    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6"]
Nov 03 17:20:43.073971 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.073931    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-kqh9k\""
Nov 03 17:20:43.083825 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.083791    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54"]
Nov 03 17:20:43.118500 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.118458    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30c4e40a-35f1-4250-8a7a-653467187df4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6\" (UID: \"30c4e40a-35f1-4250-8a7a-653467187df4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6"
Nov 03 17:20:43.119329 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.118723    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8x7v\" (UniqueName: \"kubernetes.io/projected/30c4e40a-35f1-4250-8a7a-653467187df4-kube-api-access-s8x7v\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6\" (UID: \"30c4e40a-35f1-4250-8a7a-653467187df4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6"
Nov 03 17:20:43.119329 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.118794    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/167c3418-6216-4e27-9d9b-02a28493a4d6-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6\" (UID: \"167c3418-6216-4e27-9d9b-02a28493a4d6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6"
Nov 03 17:20:43.119329 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.118825    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/167c3418-6216-4e27-9d9b-02a28493a4d6-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6\" (UID: \"167c3418-6216-4e27-9d9b-02a28493a4d6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6"
Nov 03 17:20:43.119329 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.118875    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq5pc\" (UniqueName: \"kubernetes.io/projected/0d18210c-d4c7-464f-92a3-7ec1d45821b5-kube-api-access-sq5pc\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54\" (UID: \"0d18210c-d4c7-464f-92a3-7ec1d45821b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54"
Nov 03 17:20:43.119329 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.118997    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5hnm\" (UniqueName: \"kubernetes.io/projected/167c3418-6216-4e27-9d9b-02a28493a4d6-kube-api-access-r5hnm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6\" (UID: \"167c3418-6216-4e27-9d9b-02a28493a4d6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6"
Nov 03 17:20:43.119329 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.119161    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30c4e40a-35f1-4250-8a7a-653467187df4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6\" (UID: \"30c4e40a-35f1-4250-8a7a-653467187df4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6"
Nov 03 17:20:43.119329 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.119191    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/167c3418-6216-4e27-9d9b-02a28493a4d6-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6\" (UID: \"167c3418-6216-4e27-9d9b-02a28493a4d6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6"
Nov 03 17:20:43.119329 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.119198    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d18210c-d4c7-464f-92a3-7ec1d45821b5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54\" (UID: \"0d18210c-d4c7-464f-92a3-7ec1d45821b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54"
Nov 03 17:20:43.119329 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.119282    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/167c3418-6216-4e27-9d9b-02a28493a4d6-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6\" (UID: \"167c3418-6216-4e27-9d9b-02a28493a4d6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6"
Nov 03 17:20:43.119329 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.119321    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d18210c-d4c7-464f-92a3-7ec1d45821b5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54\" (UID: \"0d18210c-d4c7-464f-92a3-7ec1d45821b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54"
Nov 03 17:20:43.150913 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.150883    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-jlc64\""
Nov 03 17:20:43.180490 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.180418    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5hnm\" (UniqueName: \"kubernetes.io/projected/167c3418-6216-4e27-9d9b-02a28493a4d6-kube-api-access-r5hnm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6\" (UID: \"167c3418-6216-4e27-9d9b-02a28493a4d6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6"
Nov 03 17:20:43.220572 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.220537    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq5pc\" (UniqueName: \"kubernetes.io/projected/0d18210c-d4c7-464f-92a3-7ec1d45821b5-kube-api-access-sq5pc\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54\" (UID: \"0d18210c-d4c7-464f-92a3-7ec1d45821b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54"
Nov 03 17:20:43.220762 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.220586    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30c4e40a-35f1-4250-8a7a-653467187df4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6\" (UID: \"30c4e40a-35f1-4250-8a7a-653467187df4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6"
Nov 03 17:20:43.220762 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.220612    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d18210c-d4c7-464f-92a3-7ec1d45821b5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54\" (UID: \"0d18210c-d4c7-464f-92a3-7ec1d45821b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54"
Nov 03 17:20:43.220762 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.220722    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d18210c-d4c7-464f-92a3-7ec1d45821b5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54\" (UID: \"0d18210c-d4c7-464f-92a3-7ec1d45821b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54"
Nov 03 17:20:43.220931 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.220790    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30c4e40a-35f1-4250-8a7a-653467187df4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6\" (UID: \"30c4e40a-35f1-4250-8a7a-653467187df4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6"
Nov 03 17:20:43.221028 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.221002    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d18210c-d4c7-464f-92a3-7ec1d45821b5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54\" (UID: \"0d18210c-d4c7-464f-92a3-7ec1d45821b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54"
Nov 03 17:20:43.221085 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.221048    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d18210c-d4c7-464f-92a3-7ec1d45821b5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54\" (UID: \"0d18210c-d4c7-464f-92a3-7ec1d45821b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54"
Nov 03 17:20:43.221298 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.221271    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30c4e40a-35f1-4250-8a7a-653467187df4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6\" (UID: \"30c4e40a-35f1-4250-8a7a-653467187df4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6"
Nov 03 17:20:43.221442 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.220989    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8x7v\" (UniqueName: \"kubernetes.io/projected/30c4e40a-35f1-4250-8a7a-653467187df4-kube-api-access-s8x7v\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6\" (UID: \"30c4e40a-35f1-4250-8a7a-653467187df4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6"
Nov 03 17:20:43.221442 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.221331    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30c4e40a-35f1-4250-8a7a-653467187df4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6\" (UID: \"30c4e40a-35f1-4250-8a7a-653467187df4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6"
Nov 03 17:20:43.242912 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.242885    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6"
Nov 03 17:20:43.281684 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.281601    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8x7v\" (UniqueName: \"kubernetes.io/projected/30c4e40a-35f1-4250-8a7a-653467187df4-kube-api-access-s8x7v\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6\" (UID: \"30c4e40a-35f1-4250-8a7a-653467187df4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6"
Nov 03 17:20:43.281684 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.281601    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq5pc\" (UniqueName: \"kubernetes.io/projected/0d18210c-d4c7-464f-92a3-7ec1d45821b5-kube-api-access-sq5pc\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54\" (UID: \"0d18210c-d4c7-464f-92a3-7ec1d45821b5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54"
Nov 03 17:20:43.338979 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.338947    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6"
Nov 03 17:20:43.347745 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.347717    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54"
Nov 03 17:20:43.626071 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.626034    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6"]
Nov 03 17:20:43.632866 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:20:43.632836    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod167c3418_6216_4e27_9d9b_02a28493a4d6.slice/crio-1948fcb8b59e8264ddca454b275945a313a9ee42043e528ea01dec05d6973f6e WatchSource:0}: Error finding container 1948fcb8b59e8264ddca454b275945a313a9ee42043e528ea01dec05d6973f6e: Status 404 returned error can't find the container with id 1948fcb8b59e8264ddca454b275945a313a9ee42043e528ea01dec05d6973f6e
Nov 03 17:20:43.729879 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.729845    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6"]
Nov 03 17:20:43.735916 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:20:43.735889    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c4e40a_35f1_4250_8a7a_653467187df4.slice/crio-4a07c4231f9d5e28f0d682414a4ed1163427e5010e9866f6910b4f54e1a3c31a WatchSource:0}: Error finding container 4a07c4231f9d5e28f0d682414a4ed1163427e5010e9866f6910b4f54e1a3c31a: Status 404 returned error can't find the container with id 4a07c4231f9d5e28f0d682414a4ed1163427e5010e9866f6910b4f54e1a3c31a
Nov 03 17:20:43.739999 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:43.739890    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54"]
Nov 03 17:20:43.746042 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:20:43.746011    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d18210c_d4c7_464f_92a3_7ec1d45821b5.slice/crio-af1cdfc414be4b458a31c566d09ae324537393e1840341ab96e1892175f40335 WatchSource:0}: Error finding container af1cdfc414be4b458a31c566d09ae324537393e1840341ab96e1892175f40335: Status 404 returned error can't find the container with id af1cdfc414be4b458a31c566d09ae324537393e1840341ab96e1892175f40335
Nov 03 17:20:44.162751 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:44.162719    5021 generic.go:356] "Generic (PLEG): container finished" podID="5f594dcd-0946-4c5f-904c-576029113992" containerID="aa8cfa7c9efb7ce5278ebe4e41735405f97bc067ff61772f8a2ea9863bca8639" exitCode=0
Nov 03 17:20:44.163220 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:44.162807    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh" event={"ID":"5f594dcd-0946-4c5f-904c-576029113992","Type":"ContainerDied","Data":"aa8cfa7c9efb7ce5278ebe4e41735405f97bc067ff61772f8a2ea9863bca8639"}
Nov 03 17:20:44.164041 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:44.164017    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6" event={"ID":"167c3418-6216-4e27-9d9b-02a28493a4d6","Type":"ContainerStarted","Data":"1948fcb8b59e8264ddca454b275945a313a9ee42043e528ea01dec05d6973f6e"}
Nov 03 17:20:44.165251 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:44.165182    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54" event={"ID":"0d18210c-d4c7-464f-92a3-7ec1d45821b5","Type":"ContainerStarted","Data":"af1cdfc414be4b458a31c566d09ae324537393e1840341ab96e1892175f40335"}
Nov 03 17:20:44.166454 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:44.166432    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6" event={"ID":"30c4e40a-35f1-4250-8a7a-653467187df4","Type":"ContainerStarted","Data":"4a07c4231f9d5e28f0d682414a4ed1163427e5010e9866f6910b4f54e1a3c31a"}
Nov 03 17:20:45.172528 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:45.172449    5021 generic.go:356] "Generic (PLEG): container finished" podID="167c3418-6216-4e27-9d9b-02a28493a4d6" containerID="08b1b7818a8a2b0317841e3c8d5335ced427f6dfd2071bcd63ce952af6f2d5fe" exitCode=0
Nov 03 17:20:45.172951 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:45.172541    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6" event={"ID":"167c3418-6216-4e27-9d9b-02a28493a4d6","Type":"ContainerDied","Data":"08b1b7818a8a2b0317841e3c8d5335ced427f6dfd2071bcd63ce952af6f2d5fe"}
Nov 03 17:20:45.174198 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:45.174172    5021 generic.go:356] "Generic (PLEG): container finished" podID="0d18210c-d4c7-464f-92a3-7ec1d45821b5" containerID="0ec39f553875fdf8a6475a4e1117a616c872b081ca9f4ea519c75f0875a82ee2" exitCode=0
Nov 03 17:20:45.174318 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:45.174279    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54" event={"ID":"0d18210c-d4c7-464f-92a3-7ec1d45821b5","Type":"ContainerDied","Data":"0ec39f553875fdf8a6475a4e1117a616c872b081ca9f4ea519c75f0875a82ee2"}
Nov 03 17:20:45.175836 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:45.175806    5021 generic.go:356] "Generic (PLEG): container finished" podID="30c4e40a-35f1-4250-8a7a-653467187df4" containerID="8425449cd5a7b1d8b56227885d92fbaedbc84ccbd36d5aa64291f8b46d3356ef" exitCode=0
Nov 03 17:20:45.175950 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:45.175889    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6" event={"ID":"30c4e40a-35f1-4250-8a7a-653467187df4","Type":"ContainerDied","Data":"8425449cd5a7b1d8b56227885d92fbaedbc84ccbd36d5aa64291f8b46d3356ef"}
Nov 03 17:20:48.191863 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:48.191822    5021 generic.go:356] "Generic (PLEG): container finished" podID="167c3418-6216-4e27-9d9b-02a28493a4d6" containerID="c99f77768983a177a99c1aa79c4036ae89b125274f7fb53d2a3bedda3651c74c" exitCode=0
Nov 03 17:20:48.192348 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:48.191893    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6" event={"ID":"167c3418-6216-4e27-9d9b-02a28493a4d6","Type":"ContainerDied","Data":"c99f77768983a177a99c1aa79c4036ae89b125274f7fb53d2a3bedda3651c74c"}
Nov 03 17:20:48.193980 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:48.193959    5021 generic.go:356] "Generic (PLEG): container finished" podID="0d18210c-d4c7-464f-92a3-7ec1d45821b5" containerID="abc9629fa89a846f55f89ab4edd6addb1de91570f30a180fcca56a5cb379725d" exitCode=0
Nov 03 17:20:48.194247 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:48.194199    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54" event={"ID":"0d18210c-d4c7-464f-92a3-7ec1d45821b5","Type":"ContainerDied","Data":"abc9629fa89a846f55f89ab4edd6addb1de91570f30a180fcca56a5cb379725d"}
Nov 03 17:20:48.196233 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:48.196200    5021 generic.go:356] "Generic (PLEG): container finished" podID="30c4e40a-35f1-4250-8a7a-653467187df4" containerID="c350be18b4fabb4150238997ea68b21923ba7ed65a4b000b6f4f7fa0b142c9de" exitCode=0
Nov 03 17:20:48.196375 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:48.196321    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6" event={"ID":"30c4e40a-35f1-4250-8a7a-653467187df4","Type":"ContainerDied","Data":"c350be18b4fabb4150238997ea68b21923ba7ed65a4b000b6f4f7fa0b142c9de"}
Nov 03 17:20:50.215336 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:50.214377    5021 generic.go:356] "Generic (PLEG): container finished" podID="5f594dcd-0946-4c5f-904c-576029113992" containerID="1d4ff721a96a4a754868af4bd51451fd8ebd61531972b9d4723800614c38f5f1" exitCode=0
Nov 03 17:20:50.215336 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:50.214454    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh" event={"ID":"5f594dcd-0946-4c5f-904c-576029113992","Type":"ContainerDied","Data":"1d4ff721a96a4a754868af4bd51451fd8ebd61531972b9d4723800614c38f5f1"}
Nov 03 17:20:58.269121 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:58.269085    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54" event={"ID":"0d18210c-d4c7-464f-92a3-7ec1d45821b5","Type":"ContainerStarted","Data":"db75cd94b052d98f313b22801f649e778d0fcfe93455fcd4ee833a2deb22486d"}
Nov 03 17:20:58.421851 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:58.421790    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54" podStartSLOduration=3.675007137 podStartE2EDuration="16.421777651s" totalImagesPullingTime="12.746770514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:20:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:20:58.42061041 +0000 UTC m=+258.621948463" watchObservedRunningTime="2026-11-03 17:20:58.421777651 +0000 UTC m=+258.623115702"
Nov 03 17:20:59.275908 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:59.275878    5021 generic.go:356] "Generic (PLEG): container finished" podID="167c3418-6216-4e27-9d9b-02a28493a4d6" containerID="bd12b50de9263b707e020104de10ad5dcdc4c1e6b35a17dc42d5cb4a7b257759" exitCode=0
Nov 03 17:20:59.276274 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:59.275955    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6" event={"ID":"167c3418-6216-4e27-9d9b-02a28493a4d6","Type":"ContainerDied","Data":"bd12b50de9263b707e020104de10ad5dcdc4c1e6b35a17dc42d5cb4a7b257759"}
Nov 03 17:20:59.277972 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:59.277951    5021 generic.go:356] "Generic (PLEG): container finished" podID="0d18210c-d4c7-464f-92a3-7ec1d45821b5" containerID="db75cd94b052d98f313b22801f649e778d0fcfe93455fcd4ee833a2deb22486d" exitCode=0
Nov 03 17:20:59.278075 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:59.278030    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54" event={"ID":"0d18210c-d4c7-464f-92a3-7ec1d45821b5","Type":"ContainerDied","Data":"db75cd94b052d98f313b22801f649e778d0fcfe93455fcd4ee833a2deb22486d"}
Nov 03 17:20:59.279922 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:59.279902    5021 generic.go:356] "Generic (PLEG): container finished" podID="30c4e40a-35f1-4250-8a7a-653467187df4" containerID="a523ee30f4040b4f40e23351b0223541e1f889a3f8e4da0c610c62c120ac354e" exitCode=0
Nov 03 17:20:59.280019 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:59.279986    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6" event={"ID":"30c4e40a-35f1-4250-8a7a-653467187df4","Type":"ContainerDied","Data":"a523ee30f4040b4f40e23351b0223541e1f889a3f8e4da0c610c62c120ac354e"}
Nov 03 17:20:59.561874 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:20:59.561813    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh" podStartSLOduration=2.592024311 podStartE2EDuration="22.561798397s" totalImagesPullingTime="19.969774086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:20:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:20:59.560939078 +0000 UTC m=+259.762277131" watchObservedRunningTime="2026-11-03 17:20:59.561798397 +0000 UTC m=+259.763136448"
Nov 03 17:21:00.288066 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.288031    5021 generic.go:356] "Generic (PLEG): container finished" podID="5f594dcd-0946-4c5f-904c-576029113992" containerID="ccfa6d3db41660fb88d7ffd2dba31320094ce5b7290484c7ed24cf9d8e67cb7e" exitCode=0
Nov 03 17:21:00.288460 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.288101    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh" event={"ID":"5f594dcd-0946-4c5f-904c-576029113992","Type":"ContainerDied","Data":"ccfa6d3db41660fb88d7ffd2dba31320094ce5b7290484c7ed24cf9d8e67cb7e"}
Nov 03 17:21:00.419763 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.419733    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6"
Nov 03 17:21:00.452811 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.452787    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54"
Nov 03 17:21:00.465436 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.465412    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6"
Nov 03 17:21:00.582269 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.582165    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/167c3418-6216-4e27-9d9b-02a28493a4d6-util\" (UniqueName: \"kubernetes.io/empty-dir/167c3418-6216-4e27-9d9b-02a28493a4d6-util\") pod \"167c3418-6216-4e27-9d9b-02a28493a4d6\" (UID: \"167c3418-6216-4e27-9d9b-02a28493a4d6\") "
Nov 03 17:21:00.582269 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.582208    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d18210c-d4c7-464f-92a3-7ec1d45821b5-bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d18210c-d4c7-464f-92a3-7ec1d45821b5-bundle\") pod \"0d18210c-d4c7-464f-92a3-7ec1d45821b5\" (UID: \"0d18210c-d4c7-464f-92a3-7ec1d45821b5\") "
Nov 03 17:21:00.582504 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.582292    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d18210c-d4c7-464f-92a3-7ec1d45821b5-kube-api-access-sq5pc\" (UniqueName: \"kubernetes.io/projected/0d18210c-d4c7-464f-92a3-7ec1d45821b5-kube-api-access-sq5pc\") pod \"0d18210c-d4c7-464f-92a3-7ec1d45821b5\" (UID: \"0d18210c-d4c7-464f-92a3-7ec1d45821b5\") "
Nov 03 17:21:00.582504 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.582319    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/30c4e40a-35f1-4250-8a7a-653467187df4-bundle\" (UniqueName: \"kubernetes.io/empty-dir/30c4e40a-35f1-4250-8a7a-653467187df4-bundle\") pod \"30c4e40a-35f1-4250-8a7a-653467187df4\" (UID: \"30c4e40a-35f1-4250-8a7a-653467187df4\") "
Nov 03 17:21:00.582504 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.582361    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/30c4e40a-35f1-4250-8a7a-653467187df4-kube-api-access-s8x7v\" (UniqueName: \"kubernetes.io/projected/30c4e40a-35f1-4250-8a7a-653467187df4-kube-api-access-s8x7v\") pod \"30c4e40a-35f1-4250-8a7a-653467187df4\" (UID: \"30c4e40a-35f1-4250-8a7a-653467187df4\") "
Nov 03 17:21:00.582504 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.582393    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/167c3418-6216-4e27-9d9b-02a28493a4d6-bundle\" (UniqueName: \"kubernetes.io/empty-dir/167c3418-6216-4e27-9d9b-02a28493a4d6-bundle\") pod \"167c3418-6216-4e27-9d9b-02a28493a4d6\" (UID: \"167c3418-6216-4e27-9d9b-02a28493a4d6\") "
Nov 03 17:21:00.582504 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.582418    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/30c4e40a-35f1-4250-8a7a-653467187df4-util\" (UniqueName: \"kubernetes.io/empty-dir/30c4e40a-35f1-4250-8a7a-653467187df4-util\") pod \"30c4e40a-35f1-4250-8a7a-653467187df4\" (UID: \"30c4e40a-35f1-4250-8a7a-653467187df4\") "
Nov 03 17:21:00.582892 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.582862    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d18210c-d4c7-464f-92a3-7ec1d45821b5-bundle" pod "0d18210c-d4c7-464f-92a3-7ec1d45821b5" (UID: "0d18210c-d4c7-464f-92a3-7ec1d45821b5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:21:00.582966 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.582896    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30c4e40a-35f1-4250-8a7a-653467187df4-bundle" pod "30c4e40a-35f1-4250-8a7a-653467187df4" (UID: "30c4e40a-35f1-4250-8a7a-653467187df4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:21:00.583059 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.583023    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/167c3418-6216-4e27-9d9b-02a28493a4d6-bundle" pod "167c3418-6216-4e27-9d9b-02a28493a4d6" (UID: "167c3418-6216-4e27-9d9b-02a28493a4d6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:21:00.583176 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.582448    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/167c3418-6216-4e27-9d9b-02a28493a4d6-kube-api-access-r5hnm\" (UniqueName: \"kubernetes.io/projected/167c3418-6216-4e27-9d9b-02a28493a4d6-kube-api-access-r5hnm\") pod \"167c3418-6216-4e27-9d9b-02a28493a4d6\" (UID: \"167c3418-6216-4e27-9d9b-02a28493a4d6\") "
Nov 03 17:21:00.583176 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.583166    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d18210c-d4c7-464f-92a3-7ec1d45821b5-util\" (UniqueName: \"kubernetes.io/empty-dir/0d18210c-d4c7-464f-92a3-7ec1d45821b5-util\") pod \"0d18210c-d4c7-464f-92a3-7ec1d45821b5\" (UID: \"0d18210c-d4c7-464f-92a3-7ec1d45821b5\") "
Nov 03 17:21:00.583881 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.583863    5021 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/30c4e40a-35f1-4250-8a7a-653467187df4-bundle\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:21:00.583987 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.583885    5021 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/167c3418-6216-4e27-9d9b-02a28493a4d6-bundle\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:21:00.583987 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.583898    5021 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d18210c-d4c7-464f-92a3-7ec1d45821b5-bundle\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:21:00.585187 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.585155    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30c4e40a-35f1-4250-8a7a-653467187df4-kube-api-access-s8x7v" pod "30c4e40a-35f1-4250-8a7a-653467187df4" (UID: "30c4e40a-35f1-4250-8a7a-653467187df4"). InnerVolumeSpecName "kube-api-access-s8x7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:21:00.585271 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.585198    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d18210c-d4c7-464f-92a3-7ec1d45821b5-kube-api-access-sq5pc" pod "0d18210c-d4c7-464f-92a3-7ec1d45821b5" (UID: "0d18210c-d4c7-464f-92a3-7ec1d45821b5"). InnerVolumeSpecName "kube-api-access-sq5pc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:21:00.585509 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.585483    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/167c3418-6216-4e27-9d9b-02a28493a4d6-kube-api-access-r5hnm" pod "167c3418-6216-4e27-9d9b-02a28493a4d6" (UID: "167c3418-6216-4e27-9d9b-02a28493a4d6"). InnerVolumeSpecName "kube-api-access-r5hnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:21:00.587292 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.587273    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d18210c-d4c7-464f-92a3-7ec1d45821b5-util" pod "0d18210c-d4c7-464f-92a3-7ec1d45821b5" (UID: "0d18210c-d4c7-464f-92a3-7ec1d45821b5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:21:00.587890 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.587866    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30c4e40a-35f1-4250-8a7a-653467187df4-util" pod "30c4e40a-35f1-4250-8a7a-653467187df4" (UID: "30c4e40a-35f1-4250-8a7a-653467187df4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:21:00.588468 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.588445    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/167c3418-6216-4e27-9d9b-02a28493a4d6-util" pod "167c3418-6216-4e27-9d9b-02a28493a4d6" (UID: "167c3418-6216-4e27-9d9b-02a28493a4d6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:21:00.684342 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.684305    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sq5pc\" (UniqueName: \"kubernetes.io/projected/0d18210c-d4c7-464f-92a3-7ec1d45821b5-kube-api-access-sq5pc\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:21:00.684342 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.684335    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8x7v\" (UniqueName: \"kubernetes.io/projected/30c4e40a-35f1-4250-8a7a-653467187df4-kube-api-access-s8x7v\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:21:00.684342 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.684345    5021 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/30c4e40a-35f1-4250-8a7a-653467187df4-util\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:21:00.684570 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.684354    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5hnm\" (UniqueName: \"kubernetes.io/projected/167c3418-6216-4e27-9d9b-02a28493a4d6-kube-api-access-r5hnm\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:21:00.684570 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.684365    5021 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d18210c-d4c7-464f-92a3-7ec1d45821b5-util\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:21:00.684570 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:00.684372    5021 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/167c3418-6216-4e27-9d9b-02a28493a4d6-util\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:21:01.294296 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.294261    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54" event={"ID":"0d18210c-d4c7-464f-92a3-7ec1d45821b5","Type":"ContainerDied","Data":"af1cdfc414be4b458a31c566d09ae324537393e1840341ab96e1892175f40335"}
Nov 03 17:21:01.294706 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.294315    5021 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af1cdfc414be4b458a31c566d09ae324537393e1840341ab96e1892175f40335"
Nov 03 17:21:01.294706 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.294314    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rvw54"
Nov 03 17:21:01.296276 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.296253    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6"
Nov 03 17:21:01.296418 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.296255    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xpfr6" event={"ID":"30c4e40a-35f1-4250-8a7a-653467187df4","Type":"ContainerDied","Data":"4a07c4231f9d5e28f0d682414a4ed1163427e5010e9866f6910b4f54e1a3c31a"}
Nov 03 17:21:01.296418 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.296368    5021 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a07c4231f9d5e28f0d682414a4ed1163427e5010e9866f6910b4f54e1a3c31a"
Nov 03 17:21:01.298273 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.298243    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6" event={"ID":"167c3418-6216-4e27-9d9b-02a28493a4d6","Type":"ContainerDied","Data":"1948fcb8b59e8264ddca454b275945a313a9ee42043e528ea01dec05d6973f6e"}
Nov 03 17:21:01.298273 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.298268    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cvr2j6"
Nov 03 17:21:01.298453 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.298289    5021 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1948fcb8b59e8264ddca454b275945a313a9ee42043e528ea01dec05d6973f6e"
Nov 03 17:21:01.429121 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.429096    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh"
Nov 03 17:21:01.592118 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.592021    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f594dcd-0946-4c5f-904c-576029113992-util\" (UniqueName: \"kubernetes.io/empty-dir/5f594dcd-0946-4c5f-904c-576029113992-util\") pod \"5f594dcd-0946-4c5f-904c-576029113992\" (UID: \"5f594dcd-0946-4c5f-904c-576029113992\") "
Nov 03 17:21:01.592292 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.592136    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f594dcd-0946-4c5f-904c-576029113992-kube-api-access-z5ksh\" (UniqueName: \"kubernetes.io/projected/5f594dcd-0946-4c5f-904c-576029113992-kube-api-access-z5ksh\") pod \"5f594dcd-0946-4c5f-904c-576029113992\" (UID: \"5f594dcd-0946-4c5f-904c-576029113992\") "
Nov 03 17:21:01.592292 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.592164    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f594dcd-0946-4c5f-904c-576029113992-bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f594dcd-0946-4c5f-904c-576029113992-bundle\") pod \"5f594dcd-0946-4c5f-904c-576029113992\" (UID: \"5f594dcd-0946-4c5f-904c-576029113992\") "
Nov 03 17:21:01.592545 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.592516    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f594dcd-0946-4c5f-904c-576029113992-bundle" pod "5f594dcd-0946-4c5f-904c-576029113992" (UID: "5f594dcd-0946-4c5f-904c-576029113992"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:21:01.594254 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.594213    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f594dcd-0946-4c5f-904c-576029113992-kube-api-access-z5ksh" pod "5f594dcd-0946-4c5f-904c-576029113992" (UID: "5f594dcd-0946-4c5f-904c-576029113992"). InnerVolumeSpecName "kube-api-access-z5ksh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:21:01.597684 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.597656    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f594dcd-0946-4c5f-904c-576029113992-util" pod "5f594dcd-0946-4c5f-904c-576029113992" (UID: "5f594dcd-0946-4c5f-904c-576029113992"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:21:01.693597 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.693558    5021 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f594dcd-0946-4c5f-904c-576029113992-util\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:21:01.693597 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.693594    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5ksh\" (UniqueName: \"kubernetes.io/projected/5f594dcd-0946-4c5f-904c-576029113992-kube-api-access-z5ksh\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:21:01.693597 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:01.693607    5021 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f594dcd-0946-4c5f-904c-576029113992-bundle\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:21:02.304198 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:02.304111    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh" event={"ID":"5f594dcd-0946-4c5f-904c-576029113992","Type":"ContainerDied","Data":"14e3f08ff58c283ba483368bc6de15887f66c3939a11cb793ab4fa57612930d1"}
Nov 03 17:21:02.304198 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:02.304161    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644tvqjh"
Nov 03 17:21:02.304198 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:02.304170    5021 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14e3f08ff58c283ba483368bc6de15887f66c3939a11cb793ab4fa57612930d1"
Nov 03 17:21:07.044390 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:21:07.044353    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:21:10.666108 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666073    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-flqsl"]
Nov 03 17:21:10.666517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666408    5021 cpu_manager.go:414] "containerMap: removing container" podUID="167c3418-6216-4e27-9d9b-02a28493a4d6" containerName="util"
Nov 03 17:21:10.666517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666420    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="167c3418-6216-4e27-9d9b-02a28493a4d6" containerName="util"
Nov 03 17:21:10.666517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666430    5021 cpu_manager.go:414] "containerMap: removing container" podUID="0d18210c-d4c7-464f-92a3-7ec1d45821b5" containerName="util"
Nov 03 17:21:10.666517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666435    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d18210c-d4c7-464f-92a3-7ec1d45821b5" containerName="util"
Nov 03 17:21:10.666517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666445    5021 cpu_manager.go:414] "containerMap: removing container" podUID="30c4e40a-35f1-4250-8a7a-653467187df4" containerName="extract"
Nov 03 17:21:10.666517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666450    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="30c4e40a-35f1-4250-8a7a-653467187df4" containerName="extract"
Nov 03 17:21:10.666517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666461    5021 cpu_manager.go:414] "containerMap: removing container" podUID="0d18210c-d4c7-464f-92a3-7ec1d45821b5" containerName="pull"
Nov 03 17:21:10.666517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666465    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d18210c-d4c7-464f-92a3-7ec1d45821b5" containerName="pull"
Nov 03 17:21:10.666517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666471    5021 cpu_manager.go:414] "containerMap: removing container" podUID="5f594dcd-0946-4c5f-904c-576029113992" containerName="extract"
Nov 03 17:21:10.666517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666476    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f594dcd-0946-4c5f-904c-576029113992" containerName="extract"
Nov 03 17:21:10.666517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666488    5021 cpu_manager.go:414] "containerMap: removing container" podUID="5f594dcd-0946-4c5f-904c-576029113992" containerName="util"
Nov 03 17:21:10.666517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666492    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f594dcd-0946-4c5f-904c-576029113992" containerName="util"
Nov 03 17:21:10.666517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666500    5021 cpu_manager.go:414] "containerMap: removing container" podUID="5f594dcd-0946-4c5f-904c-576029113992" containerName="pull"
Nov 03 17:21:10.666517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666504    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f594dcd-0946-4c5f-904c-576029113992" containerName="pull"
Nov 03 17:21:10.666517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666512    5021 cpu_manager.go:414] "containerMap: removing container" podUID="30c4e40a-35f1-4250-8a7a-653467187df4" containerName="util"
Nov 03 17:21:10.666517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666516    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="30c4e40a-35f1-4250-8a7a-653467187df4" containerName="util"
Nov 03 17:21:10.666517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666524    5021 cpu_manager.go:414] "containerMap: removing container" podUID="167c3418-6216-4e27-9d9b-02a28493a4d6" containerName="pull"
Nov 03 17:21:10.667159 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666529    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="167c3418-6216-4e27-9d9b-02a28493a4d6" containerName="pull"
Nov 03 17:21:10.667159 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666541    5021 cpu_manager.go:414] "containerMap: removing container" podUID="0d18210c-d4c7-464f-92a3-7ec1d45821b5" containerName="extract"
Nov 03 17:21:10.667159 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666546    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d18210c-d4c7-464f-92a3-7ec1d45821b5" containerName="extract"
Nov 03 17:21:10.667159 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666551    5021 cpu_manager.go:414] "containerMap: removing container" podUID="167c3418-6216-4e27-9d9b-02a28493a4d6" containerName="extract"
Nov 03 17:21:10.667159 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666556    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="167c3418-6216-4e27-9d9b-02a28493a4d6" containerName="extract"
Nov 03 17:21:10.667159 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666564    5021 cpu_manager.go:414] "containerMap: removing container" podUID="30c4e40a-35f1-4250-8a7a-653467187df4" containerName="pull"
Nov 03 17:21:10.667159 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666568    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="30c4e40a-35f1-4250-8a7a-653467187df4" containerName="pull"
Nov 03 17:21:10.667159 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666616    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="30c4e40a-35f1-4250-8a7a-653467187df4" containerName="extract"
Nov 03 17:21:10.667159 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666625    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="5f594dcd-0946-4c5f-904c-576029113992" containerName="extract"
Nov 03 17:21:10.667159 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666634    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d18210c-d4c7-464f-92a3-7ec1d45821b5" containerName="extract"
Nov 03 17:21:10.667159 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.666640    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="167c3418-6216-4e27-9d9b-02a28493a4d6" containerName="extract"
Nov 03 17:21:10.668595 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.668575    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-flqsl"
Nov 03 17:21:10.722297 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.722264    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Nov 03 17:21:10.767494 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.767456    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49837b08-b3b1-4ab4-8cb7-7beffaad1fae-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-flqsl\" (UID: \"49837b08-b3b1-4ab4-8cb7-7beffaad1fae\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-flqsl"
Nov 03 17:21:10.767643 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.767506    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwnsf\" (UniqueName: \"kubernetes.io/projected/49837b08-b3b1-4ab4-8cb7-7beffaad1fae-kube-api-access-lwnsf\") pod \"cert-manager-cainjector-5c57bbd4fc-flqsl\" (UID: \"49837b08-b3b1-4ab4-8cb7-7beffaad1fae\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-flqsl"
Nov 03 17:21:10.769441 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.769421    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Nov 03 17:21:10.769441 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.769433    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-bvr9z\""
Nov 03 17:21:10.771126 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.771105    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-flqsl"]
Nov 03 17:21:10.868355 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.868321    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwnsf\" (UniqueName: \"kubernetes.io/projected/49837b08-b3b1-4ab4-8cb7-7beffaad1fae-kube-api-access-lwnsf\") pod \"cert-manager-cainjector-5c57bbd4fc-flqsl\" (UID: \"49837b08-b3b1-4ab4-8cb7-7beffaad1fae\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-flqsl"
Nov 03 17:21:10.868524 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.868390    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49837b08-b3b1-4ab4-8cb7-7beffaad1fae-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-flqsl\" (UID: \"49837b08-b3b1-4ab4-8cb7-7beffaad1fae\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-flqsl"
Nov 03 17:21:10.928053 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.927981    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49837b08-b3b1-4ab4-8cb7-7beffaad1fae-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-flqsl\" (UID: \"49837b08-b3b1-4ab4-8cb7-7beffaad1fae\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-flqsl"
Nov 03 17:21:10.928168 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.928119    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwnsf\" (UniqueName: \"kubernetes.io/projected/49837b08-b3b1-4ab4-8cb7-7beffaad1fae-kube-api-access-lwnsf\") pod \"cert-manager-cainjector-5c57bbd4fc-flqsl\" (UID: \"49837b08-b3b1-4ab4-8cb7-7beffaad1fae\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-flqsl"
Nov 03 17:21:10.990401 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:10.990373    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-flqsl"
Nov 03 17:21:11.108655 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:11.108622    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-69fjk"]
Nov 03 17:21:11.111809 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:11.111781    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-69fjk"
Nov 03 17:21:11.166875 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:11.166846    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-cvh86\""
Nov 03 17:21:11.170668 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:11.170643    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Nov 03 17:21:11.170814 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:11.170673    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Nov 03 17:21:11.171171 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:11.171155    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-69fjk"]
Nov 03 17:21:11.272808 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:11.272777    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14d6c7ad-b990-4e0c-9723-e521c53f0c49-tmp\") pod \"jobset-operator-674cd59dc5-69fjk\" (UID: \"14d6c7ad-b990-4e0c-9723-e521c53f0c49\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-69fjk"
Nov 03 17:21:11.273021 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:11.272823    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kbr8\" (UniqueName: \"kubernetes.io/projected/14d6c7ad-b990-4e0c-9723-e521c53f0c49-kube-api-access-5kbr8\") pod \"jobset-operator-674cd59dc5-69fjk\" (UID: \"14d6c7ad-b990-4e0c-9723-e521c53f0c49\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-69fjk"
Nov 03 17:21:11.355387 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:11.355354    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-flqsl"]
Nov 03 17:21:11.361561 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:21:11.361535    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49837b08_b3b1_4ab4_8cb7_7beffaad1fae.slice/crio-3111ef452e2c4977b8000c1d8c6827523a7101e86b59fc3c4156f0a465ec629b WatchSource:0}: Error finding container 3111ef452e2c4977b8000c1d8c6827523a7101e86b59fc3c4156f0a465ec629b: Status 404 returned error can't find the container with id 3111ef452e2c4977b8000c1d8c6827523a7101e86b59fc3c4156f0a465ec629b
Nov 03 17:21:11.373934 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:11.373911    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14d6c7ad-b990-4e0c-9723-e521c53f0c49-tmp\") pod \"jobset-operator-674cd59dc5-69fjk\" (UID: \"14d6c7ad-b990-4e0c-9723-e521c53f0c49\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-69fjk"
Nov 03 17:21:11.374027 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:11.373955    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kbr8\" (UniqueName: \"kubernetes.io/projected/14d6c7ad-b990-4e0c-9723-e521c53f0c49-kube-api-access-5kbr8\") pod \"jobset-operator-674cd59dc5-69fjk\" (UID: \"14d6c7ad-b990-4e0c-9723-e521c53f0c49\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-69fjk"
Nov 03 17:21:11.374288 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:11.374267    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14d6c7ad-b990-4e0c-9723-e521c53f0c49-tmp\") pod \"jobset-operator-674cd59dc5-69fjk\" (UID: \"14d6c7ad-b990-4e0c-9723-e521c53f0c49\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-69fjk"
Nov 03 17:21:11.432846 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:11.432818    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kbr8\" (UniqueName: \"kubernetes.io/projected/14d6c7ad-b990-4e0c-9723-e521c53f0c49-kube-api-access-5kbr8\") pod \"jobset-operator-674cd59dc5-69fjk\" (UID: \"14d6c7ad-b990-4e0c-9723-e521c53f0c49\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-69fjk"
Nov 03 17:21:11.722140 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:11.722063    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-69fjk"
Nov 03 17:21:12.089787 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:12.089751    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-69fjk"]
Nov 03 17:21:12.095817 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:21:12.095788    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14d6c7ad_b990_4e0c_9723_e521c53f0c49.slice/crio-3ec9e4abcfb7f1dc740b77b38a9eca7fc2330c9b8828c5512a98f7ebb68a991a WatchSource:0}: Error finding container 3ec9e4abcfb7f1dc740b77b38a9eca7fc2330c9b8828c5512a98f7ebb68a991a: Status 404 returned error can't find the container with id 3ec9e4abcfb7f1dc740b77b38a9eca7fc2330c9b8828c5512a98f7ebb68a991a
Nov 03 17:21:12.347140 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:12.347052    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-69fjk" event={"ID":"14d6c7ad-b990-4e0c-9723-e521c53f0c49","Type":"ContainerStarted","Data":"3ec9e4abcfb7f1dc740b77b38a9eca7fc2330c9b8828c5512a98f7ebb68a991a"}
Nov 03 17:21:12.348296 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:12.348272    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-flqsl" event={"ID":"49837b08-b3b1-4ab4-8cb7-7beffaad1fae","Type":"ContainerStarted","Data":"3111ef452e2c4977b8000c1d8c6827523a7101e86b59fc3c4156f0a465ec629b"}
Nov 03 17:21:15.368189 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:15.368142    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-69fjk" event={"ID":"14d6c7ad-b990-4e0c-9723-e521c53f0c49","Type":"ContainerStarted","Data":"c8353011a9d518f0a6a28847f7a335a9998278a373cb2b51722ab6782b1ef072"}
Nov 03 17:21:15.509623 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:15.509558    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-69fjk" podStartSLOduration=1.3238455949999999 podStartE2EDuration="4.509544752s" totalImagesPullingTime="3.185699157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:21:15.50868137 +0000 UTC m=+275.710019423" watchObservedRunningTime="2026-11-03 17:21:15.509544752 +0000 UTC m=+275.710882805"
Nov 03 17:21:16.375753 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:16.375713    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-flqsl" event={"ID":"49837b08-b3b1-4ab4-8cb7-7beffaad1fae","Type":"ContainerStarted","Data":"fc8cdb81feee4dbd0a57e3f7c077cb03741de164ce5fb960a6ec815a6465f6d6"}
Nov 03 17:21:16.492208 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:16.492143    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-flqsl" podStartSLOduration=2.20092986 podStartE2EDuration="6.492122967s" totalImagesPullingTime="4.291193107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:21:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:21:16.491965713 +0000 UTC m=+276.693303765" watchObservedRunningTime="2026-11-03 17:21:16.492122967 +0000 UTC m=+276.693461020"
Nov 03 17:21:18.435701 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.435666    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"]
Nov 03 17:21:18.439201 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.439184    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.528791 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.528753    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a5354c7b-44db-4754-8351-0410e5dde1bc-manifests\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.528791 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.528792    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5354c7b-44db-4754-8351-0410e5dde1bc-tmp\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.528987 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.528816    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbzsc\" (UniqueName: \"kubernetes.io/projected/a5354c7b-44db-4754-8351-0410e5dde1bc-kube-api-access-hbzsc\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.528987 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.528941    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a5354c7b-44db-4754-8351-0410e5dde1bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.528987 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.528972    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5354c7b-44db-4754-8351-0410e5dde1bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.529085 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.528994    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5354c7b-44db-4754-8351-0410e5dde1bc-metrics-cert\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.567767 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.567738    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 03 17:21:18.582169 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.582144    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 03 17:21:18.582403 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.582384    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 03 17:21:18.582484 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.582388    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-n7pls\""
Nov 03 17:21:18.582484 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.582388    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 03 17:21:18.582705 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.582691    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 03 17:21:18.592320 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.592289    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"]
Nov 03 17:21:18.629771 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.629743    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5354c7b-44db-4754-8351-0410e5dde1bc-metrics-cert\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.629899 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.629799    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a5354c7b-44db-4754-8351-0410e5dde1bc-manifests\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.629953 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.629917    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5354c7b-44db-4754-8351-0410e5dde1bc-tmp\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.630004 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.629968    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbzsc\" (UniqueName: \"kubernetes.io/projected/a5354c7b-44db-4754-8351-0410e5dde1bc-kube-api-access-hbzsc\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.630052 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.630035    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a5354c7b-44db-4754-8351-0410e5dde1bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.630087 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.630065    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5354c7b-44db-4754-8351-0410e5dde1bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.630155 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.630126    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a5354c7b-44db-4754-8351-0410e5dde1bc-manifests\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.632250 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.632198    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5354c7b-44db-4754-8351-0410e5dde1bc-tmp\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.632377 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.632328    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5354c7b-44db-4754-8351-0410e5dde1bc-metrics-cert\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.632377 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.632337    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5354c7b-44db-4754-8351-0410e5dde1bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.632461 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.632431    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a5354c7b-44db-4754-8351-0410e5dde1bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.690397 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.690326    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbzsc\" (UniqueName: \"kubernetes.io/projected/a5354c7b-44db-4754-8351-0410e5dde1bc-kube-api-access-hbzsc\") pod \"opendatahub-operator-controller-manager-5cf8664c87-slvm9\" (UID: \"a5354c7b-44db-4754-8351-0410e5dde1bc\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:18.754402 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:18.754366    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:19.257109 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:19.257070    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"]
Nov 03 17:21:19.262435 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:21:19.262408    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5354c7b_44db_4754_8351_0410e5dde1bc.slice/crio-9ad43b651f9066aaef0f4f0bca418a0c939bd1a58d63c6a9d72ca86f03d1099c WatchSource:0}: Error finding container 9ad43b651f9066aaef0f4f0bca418a0c939bd1a58d63c6a9d72ca86f03d1099c: Status 404 returned error can't find the container with id 9ad43b651f9066aaef0f4f0bca418a0c939bd1a58d63c6a9d72ca86f03d1099c
Nov 03 17:21:19.390335 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:19.390299    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9" event={"ID":"a5354c7b-44db-4754-8351-0410e5dde1bc","Type":"ContainerStarted","Data":"9ad43b651f9066aaef0f4f0bca418a0c939bd1a58d63c6a9d72ca86f03d1099c"}
Nov 03 17:21:23.413683 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:23.413644    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9" event={"ID":"a5354c7b-44db-4754-8351-0410e5dde1bc","Type":"ContainerStarted","Data":"850aa8d8563fbff6920e0184621caef6a02ae7692260e1856fbe8d0f7dce3667"}
Nov 03 17:21:24.419603 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:24.419565    5021 generic.go:356] "Generic (PLEG): container finished" podID="a5354c7b-44db-4754-8351-0410e5dde1bc" containerID="850aa8d8563fbff6920e0184621caef6a02ae7692260e1856fbe8d0f7dce3667" exitCode=0
Nov 03 17:21:24.420011 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:24.419655    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9" event={"ID":"a5354c7b-44db-4754-8351-0410e5dde1bc","Type":"ContainerDied","Data":"850aa8d8563fbff6920e0184621caef6a02ae7692260e1856fbe8d0f7dce3667"}
Nov 03 17:21:25.425925 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:25.425877    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9" event={"ID":"a5354c7b-44db-4754-8351-0410e5dde1bc","Type":"ContainerStarted","Data":"953bfa794df62c378de812431e63fc10ecc2375240754acc4c55dc675d69d456"}
Nov 03 17:21:25.426345 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:25.425968    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:25.683366 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:25.683293    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9" podStartSLOduration=2.460810382 podStartE2EDuration="7.68327473s" totalImagesPullingTime="4.757364626s" totalInitContainerRuntime="465.099722ms" isStatefulPod=false podCreationTimestamp="2026-11-03 17:21:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:21:25.635652995 +0000 UTC m=+285.836991048" watchObservedRunningTime="2026-11-03 17:21:25.68327473 +0000 UTC m=+285.884612783"
Nov 03 17:21:35.301761 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:35.301723    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-bbqqn"]
Nov 03 17:21:35.307928 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:35.307904    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-bbqqn"
Nov 03 17:21:35.361034 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:35.361002    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvkvp\" (UniqueName: \"kubernetes.io/projected/21278b76-fc4f-45fc-96d3-e8898bead3dd-kube-api-access-jvkvp\") pod \"limitador-operator-controller-manager-5778bb4449-bbqqn\" (UID: \"21278b76-fc4f-45fc-96d3-e8898bead3dd\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-bbqqn"
Nov 03 17:21:35.367653 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:35.367625    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-bbqqn"]
Nov 03 17:21:35.412948 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:35.412913    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pwpps\""
Nov 03 17:21:35.412948 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:35.412937    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 03 17:21:35.415591 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:35.415576    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 03 17:21:35.462292 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:35.462254    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvkvp\" (UniqueName: \"kubernetes.io/projected/21278b76-fc4f-45fc-96d3-e8898bead3dd-kube-api-access-jvkvp\") pod \"limitador-operator-controller-manager-5778bb4449-bbqqn\" (UID: \"21278b76-fc4f-45fc-96d3-e8898bead3dd\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-bbqqn"
Nov 03 17:21:35.532879 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:35.532843    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvkvp\" (UniqueName: \"kubernetes.io/projected/21278b76-fc4f-45fc-96d3-e8898bead3dd-kube-api-access-jvkvp\") pod \"limitador-operator-controller-manager-5778bb4449-bbqqn\" (UID: \"21278b76-fc4f-45fc-96d3-e8898bead3dd\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-bbqqn"
Nov 03 17:21:35.620509 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:35.620421    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-bbqqn"
Nov 03 17:21:36.001644 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:36.001624    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-bbqqn"]
Nov 03 17:21:36.025941 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:21:36.025914    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21278b76_fc4f_45fc_96d3_e8898bead3dd.slice/crio-76c2e918cb49ed46f1460ace1d9ab5cbf4dbb73829a4304dc2c6f6a20983540a WatchSource:0}: Error finding container 76c2e918cb49ed46f1460ace1d9ab5cbf4dbb73829a4304dc2c6f6a20983540a: Status 404 returned error can't find the container with id 76c2e918cb49ed46f1460ace1d9ab5cbf4dbb73829a4304dc2c6f6a20983540a
Nov 03 17:21:36.432388 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:36.432301    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5cf8664c87-slvm9"
Nov 03 17:21:36.475505 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:36.475469    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-bbqqn" event={"ID":"21278b76-fc4f-45fc-96d3-e8898bead3dd","Type":"ContainerStarted","Data":"76c2e918cb49ed46f1460ace1d9ab5cbf4dbb73829a4304dc2c6f6a20983540a"}
Nov 03 17:21:37.044269 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:21:37.044211    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:21:40.014496 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:40.014469    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:21:40.014496 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:40.014482    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:21:40.496846 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:40.496752    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-bbqqn" event={"ID":"21278b76-fc4f-45fc-96d3-e8898bead3dd","Type":"ContainerStarted","Data":"c897a3f35ae8fa8cc14dbd7c5cbc0efada83071cc83452f889eeb4ad52c76c99"}
Nov 03 17:21:40.496846 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:40.496818    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-bbqqn"
Nov 03 17:21:40.619794 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:40.619732    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-bbqqn" podStartSLOduration=1.9764477139999999 podStartE2EDuration="5.619714583s" totalImagesPullingTime="3.643266869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:21:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:21:40.618844076 +0000 UTC m=+300.820182128" watchObservedRunningTime="2026-11-03 17:21:40.619714583 +0000 UTC m=+300.821052637"
Nov 03 17:21:51.504451 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:51.504367    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-bbqqn"
Nov 03 17:21:58.432405 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:58.432365    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5fc78d544-6rgm9"]
Nov 03 17:21:58.439000 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:58.438974    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fc78d544-6rgm9"
Nov 03 17:21:58.514806 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:58.514769    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fc78d544-6rgm9"]
Nov 03 17:21:58.563514 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:58.563474    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc948976-0edc-4e93-a9a9-58a58432b280-tmp\") pod \"kube-auth-proxy-5fc78d544-6rgm9\" (UID: \"bc948976-0edc-4e93-a9a9-58a58432b280\") " pod="openshift-ingress/kube-auth-proxy-5fc78d544-6rgm9"
Nov 03 17:21:58.563682 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:58.563526    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc948976-0edc-4e93-a9a9-58a58432b280-tls-certs\") pod \"kube-auth-proxy-5fc78d544-6rgm9\" (UID: \"bc948976-0edc-4e93-a9a9-58a58432b280\") " pod="openshift-ingress/kube-auth-proxy-5fc78d544-6rgm9"
Nov 03 17:21:58.563682 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:58.563610    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvdnr\" (UniqueName: \"kubernetes.io/projected/bc948976-0edc-4e93-a9a9-58a58432b280-kube-api-access-fvdnr\") pod \"kube-auth-proxy-5fc78d544-6rgm9\" (UID: \"bc948976-0edc-4e93-a9a9-58a58432b280\") " pod="openshift-ingress/kube-auth-proxy-5fc78d544-6rgm9"
Nov 03 17:21:58.567548 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:58.567515    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Nov 03 17:21:58.602067 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:58.602039    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-glcnq\""
Nov 03 17:21:58.608712 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:58.608688    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Nov 03 17:21:58.664164 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:58.664126    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc948976-0edc-4e93-a9a9-58a58432b280-tmp\") pod \"kube-auth-proxy-5fc78d544-6rgm9\" (UID: \"bc948976-0edc-4e93-a9a9-58a58432b280\") " pod="openshift-ingress/kube-auth-proxy-5fc78d544-6rgm9"
Nov 03 17:21:58.664366 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:58.664174    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc948976-0edc-4e93-a9a9-58a58432b280-tls-certs\") pod \"kube-auth-proxy-5fc78d544-6rgm9\" (UID: \"bc948976-0edc-4e93-a9a9-58a58432b280\") " pod="openshift-ingress/kube-auth-proxy-5fc78d544-6rgm9"
Nov 03 17:21:58.664366 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:58.664303    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvdnr\" (UniqueName: \"kubernetes.io/projected/bc948976-0edc-4e93-a9a9-58a58432b280-kube-api-access-fvdnr\") pod \"kube-auth-proxy-5fc78d544-6rgm9\" (UID: \"bc948976-0edc-4e93-a9a9-58a58432b280\") " pod="openshift-ingress/kube-auth-proxy-5fc78d544-6rgm9"
Nov 03 17:21:58.666480 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:58.666456    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc948976-0edc-4e93-a9a9-58a58432b280-tmp\") pod \"kube-auth-proxy-5fc78d544-6rgm9\" (UID: \"bc948976-0edc-4e93-a9a9-58a58432b280\") " pod="openshift-ingress/kube-auth-proxy-5fc78d544-6rgm9"
Nov 03 17:21:58.666648 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:58.666628    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc948976-0edc-4e93-a9a9-58a58432b280-tls-certs\") pod \"kube-auth-proxy-5fc78d544-6rgm9\" (UID: \"bc948976-0edc-4e93-a9a9-58a58432b280\") " pod="openshift-ingress/kube-auth-proxy-5fc78d544-6rgm9"
Nov 03 17:21:58.731566 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:58.731489    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvdnr\" (UniqueName: \"kubernetes.io/projected/bc948976-0edc-4e93-a9a9-58a58432b280-kube-api-access-fvdnr\") pod \"kube-auth-proxy-5fc78d544-6rgm9\" (UID: \"bc948976-0edc-4e93-a9a9-58a58432b280\") " pod="openshift-ingress/kube-auth-proxy-5fc78d544-6rgm9"
Nov 03 17:21:58.750342 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:58.750312    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fc78d544-6rgm9"
Nov 03 17:21:59.164672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:59.164641    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fc78d544-6rgm9"]
Nov 03 17:21:59.169773 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:21:59.169742    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc948976_0edc_4e93_a9a9_58a58432b280.slice/crio-45d6574e6bcc6e6c09faf7e32262de29a895bf53a166eafe876bcac105ada76a WatchSource:0}: Error finding container 45d6574e6bcc6e6c09faf7e32262de29a895bf53a166eafe876bcac105ada76a: Status 404 returned error can't find the container with id 45d6574e6bcc6e6c09faf7e32262de29a895bf53a166eafe876bcac105ada76a
Nov 03 17:21:59.171727 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:59.171710    5021 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 17:21:59.584129 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:21:59.584085    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fc78d544-6rgm9" event={"ID":"bc948976-0edc-4e93-a9a9-58a58432b280","Type":"ContainerStarted","Data":"45d6574e6bcc6e6c09faf7e32262de29a895bf53a166eafe876bcac105ada76a"}
Nov 03 17:22:02.603248 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:02.603184    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fc78d544-6rgm9" event={"ID":"bc948976-0edc-4e93-a9a9-58a58432b280","Type":"ContainerStarted","Data":"2edae19bfdeb4bb4a46a7ad696ef58610c8666b5e53617fffec06861ed97543e"}
Nov 03 17:22:02.725521 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:02.725468    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5fc78d544-6rgm9" podStartSLOduration=1.857033516 podStartE2EDuration="4.725453433s" totalImagesPullingTime="2.868419917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:22:02.724261414 +0000 UTC m=+322.925599467" watchObservedRunningTime="2026-11-03 17:22:02.725453433 +0000 UTC m=+322.926791484"
Nov 03 17:22:07.045177 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:22:07.045145    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:22:23.190700 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:23.190656    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-qkzl8"]
Nov 03 17:22:23.194340 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:23.194303    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-qkzl8"
Nov 03 17:22:23.249280 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:23.249248    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-qkzl8"]
Nov 03 17:22:23.279732 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:23.279697    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7ncc\" (UniqueName: \"kubernetes.io/projected/e0b33cb9-a642-4ce9-869a-6267622dc63d-kube-api-access-q7ncc\") pod \"authorino-57f7f8659f-qkzl8\" (UID: \"e0b33cb9-a642-4ce9-869a-6267622dc63d\") " pod="kuadrant-system/authorino-57f7f8659f-qkzl8"
Nov 03 17:22:23.294692 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:23.294668    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xtsl2\""
Nov 03 17:22:23.381046 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:23.381006    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7ncc\" (UniqueName: \"kubernetes.io/projected/e0b33cb9-a642-4ce9-869a-6267622dc63d-kube-api-access-q7ncc\") pod \"authorino-57f7f8659f-qkzl8\" (UID: \"e0b33cb9-a642-4ce9-869a-6267622dc63d\") " pod="kuadrant-system/authorino-57f7f8659f-qkzl8"
Nov 03 17:22:23.442993 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:23.442918    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7ncc\" (UniqueName: \"kubernetes.io/projected/e0b33cb9-a642-4ce9-869a-6267622dc63d-kube-api-access-q7ncc\") pod \"authorino-57f7f8659f-qkzl8\" (UID: \"e0b33cb9-a642-4ce9-869a-6267622dc63d\") " pod="kuadrant-system/authorino-57f7f8659f-qkzl8"
Nov 03 17:22:23.505701 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:23.505652    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-qkzl8"
Nov 03 17:22:23.887842 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:23.887805    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-qkzl8"]
Nov 03 17:22:23.893590 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:22:23.893561    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0b33cb9_a642_4ce9_869a_6267622dc63d.slice/crio-e266daa78a20fadb8336562d576e5cd1762a8eff9ddac0dc2b09d89fa4a60978 WatchSource:0}: Error finding container e266daa78a20fadb8336562d576e5cd1762a8eff9ddac0dc2b09d89fa4a60978: Status 404 returned error can't find the container with id e266daa78a20fadb8336562d576e5cd1762a8eff9ddac0dc2b09d89fa4a60978
Nov 03 17:22:24.705596 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:24.705559    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-qkzl8" event={"ID":"e0b33cb9-a642-4ce9-869a-6267622dc63d","Type":"ContainerStarted","Data":"e266daa78a20fadb8336562d576e5cd1762a8eff9ddac0dc2b09d89fa4a60978"}
Nov 03 17:22:24.906089 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:24.906058    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-tqmq6"]
Nov 03 17:22:24.910574 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:24.910548    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-tqmq6"
Nov 03 17:22:24.962148 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:24.962076    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-tqmq6"]
Nov 03 17:22:24.993029 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:24.992999    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p85lz\" (UniqueName: \"kubernetes.io/projected/29854459-4fcb-4a1a-9894-78d7abdc45b9-kube-api-access-p85lz\") pod \"authorino-56c6c9ddd5-tqmq6\" (UID: \"29854459-4fcb-4a1a-9894-78d7abdc45b9\") " pod="kuadrant-system/authorino-56c6c9ddd5-tqmq6"
Nov 03 17:22:25.094133 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:25.094102    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p85lz\" (UniqueName: \"kubernetes.io/projected/29854459-4fcb-4a1a-9894-78d7abdc45b9-kube-api-access-p85lz\") pod \"authorino-56c6c9ddd5-tqmq6\" (UID: \"29854459-4fcb-4a1a-9894-78d7abdc45b9\") " pod="kuadrant-system/authorino-56c6c9ddd5-tqmq6"
Nov 03 17:22:25.154242 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:25.154188    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p85lz\" (UniqueName: \"kubernetes.io/projected/29854459-4fcb-4a1a-9894-78d7abdc45b9-kube-api-access-p85lz\") pod \"authorino-56c6c9ddd5-tqmq6\" (UID: \"29854459-4fcb-4a1a-9894-78d7abdc45b9\") " pod="kuadrant-system/authorino-56c6c9ddd5-tqmq6"
Nov 03 17:22:25.222762 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:25.222692    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-tqmq6"
Nov 03 17:22:25.599909 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:25.599874    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-tqmq6"]
Nov 03 17:22:25.605928 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:22:25.605903    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29854459_4fcb_4a1a_9894_78d7abdc45b9.slice/crio-bf61d060388548117a5ead3a354d6073260e7e0719d275e17054803cc1e8d9c9 WatchSource:0}: Error finding container bf61d060388548117a5ead3a354d6073260e7e0719d275e17054803cc1e8d9c9: Status 404 returned error can't find the container with id bf61d060388548117a5ead3a354d6073260e7e0719d275e17054803cc1e8d9c9
Nov 03 17:22:25.712447 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:25.712409    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-tqmq6" event={"ID":"29854459-4fcb-4a1a-9894-78d7abdc45b9","Type":"ContainerStarted","Data":"bf61d060388548117a5ead3a354d6073260e7e0719d275e17054803cc1e8d9c9"}
Nov 03 17:22:28.728526 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:28.728485    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-tqmq6" event={"ID":"29854459-4fcb-4a1a-9894-78d7abdc45b9","Type":"ContainerStarted","Data":"d50ceaaf738119e8710c3aa47781c377decd6b2dd82c90635e16ad60c167a76b"}
Nov 03 17:22:28.844416 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:28.844359    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-tqmq6" podStartSLOduration=1.850407462 podStartE2EDuration="4.844344802s" totalImagesPullingTime="2.99393734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:22:28.842775854 +0000 UTC m=+349.044113907" watchObservedRunningTime="2026-11-03 17:22:28.844344802 +0000 UTC m=+349.045682853"
Nov 03 17:22:28.881335 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:28.881247    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-qkzl8"]
Nov 03 17:22:29.735713 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:29.735666    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-qkzl8" event={"ID":"e0b33cb9-a642-4ce9-869a-6267622dc63d","Type":"ContainerStarted","Data":"1c4c29a39515a2d7a8500e25162d515ae5651424c2b3a230df2053737c89e330"}
Nov 03 17:22:29.735713 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:29.735682    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-qkzl8" podUID="e0b33cb9-a642-4ce9-869a-6267622dc63d" containerName="authorino" containerID="cri-o://1c4c29a39515a2d7a8500e25162d515ae5651424c2b3a230df2053737c89e330" gracePeriod=30
Nov 03 17:22:29.855582 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:29.855527    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-qkzl8" podStartSLOduration=1.6460408850000001 podStartE2EDuration="6.855511543s" totalImagesPullingTime="5.209470658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:22:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:22:29.853001214 +0000 UTC m=+350.054339268" watchObservedRunningTime="2026-11-03 17:22:29.855511543 +0000 UTC m=+350.056849594"
Nov 03 17:22:29.990734 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:29.990675    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-qkzl8"
Nov 03 17:22:30.036743 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:30.036712    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e0b33cb9-a642-4ce9-869a-6267622dc63d-kube-api-access-q7ncc\" (UniqueName: \"kubernetes.io/projected/e0b33cb9-a642-4ce9-869a-6267622dc63d-kube-api-access-q7ncc\") pod \"e0b33cb9-a642-4ce9-869a-6267622dc63d\" (UID: \"e0b33cb9-a642-4ce9-869a-6267622dc63d\") "
Nov 03 17:22:30.038848 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:30.038823    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0b33cb9-a642-4ce9-869a-6267622dc63d-kube-api-access-q7ncc" pod "e0b33cb9-a642-4ce9-869a-6267622dc63d" (UID: "e0b33cb9-a642-4ce9-869a-6267622dc63d"). InnerVolumeSpecName "kube-api-access-q7ncc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:22:30.137446 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:30.137413    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7ncc\" (UniqueName: \"kubernetes.io/projected/e0b33cb9-a642-4ce9-869a-6267622dc63d-kube-api-access-q7ncc\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:22:30.741629 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:30.741589    5021 generic.go:356] "Generic (PLEG): container finished" podID="e0b33cb9-a642-4ce9-869a-6267622dc63d" containerID="1c4c29a39515a2d7a8500e25162d515ae5651424c2b3a230df2053737c89e330" exitCode=0
Nov 03 17:22:30.741629 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:30.741621    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-qkzl8" event={"ID":"e0b33cb9-a642-4ce9-869a-6267622dc63d","Type":"ContainerDied","Data":"1c4c29a39515a2d7a8500e25162d515ae5651424c2b3a230df2053737c89e330"}
Nov 03 17:22:30.742109 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:30.741636    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-qkzl8"
Nov 03 17:22:30.742109 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:30.741662    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-qkzl8" event={"ID":"e0b33cb9-a642-4ce9-869a-6267622dc63d","Type":"ContainerDied","Data":"e266daa78a20fadb8336562d576e5cd1762a8eff9ddac0dc2b09d89fa4a60978"}
Nov 03 17:22:30.742109 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:30.741682    5021 scope.go:122] "RemoveContainer" containerID="1c4c29a39515a2d7a8500e25162d515ae5651424c2b3a230df2053737c89e330"
Nov 03 17:22:30.750347 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:30.750330    5021 scope.go:122] "RemoveContainer" containerID="1c4c29a39515a2d7a8500e25162d515ae5651424c2b3a230df2053737c89e330"
Nov 03 17:22:30.750626 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:22:30.750606    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c4c29a39515a2d7a8500e25162d515ae5651424c2b3a230df2053737c89e330\": container with ID starting with 1c4c29a39515a2d7a8500e25162d515ae5651424c2b3a230df2053737c89e330 not found: ID does not exist" containerID="1c4c29a39515a2d7a8500e25162d515ae5651424c2b3a230df2053737c89e330"
Nov 03 17:22:30.750678 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:30.750635    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4c29a39515a2d7a8500e25162d515ae5651424c2b3a230df2053737c89e330"} err="failed to get container status \"1c4c29a39515a2d7a8500e25162d515ae5651424c2b3a230df2053737c89e330\": rpc error: code = NotFound desc = could not find container \"1c4c29a39515a2d7a8500e25162d515ae5651424c2b3a230df2053737c89e330\": container with ID starting with 1c4c29a39515a2d7a8500e25162d515ae5651424c2b3a230df2053737c89e330 not found: ID does not exist"
Nov 03 17:22:30.902890 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:30.902854    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-qkzl8"]
Nov 03 17:22:30.912643 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:30.912617    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-qkzl8"]
Nov 03 17:22:32.001443 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:32.001413    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e0b33cb9-a642-4ce9-869a-6267622dc63d" path="/var/lib/kubelet/pods/e0b33cb9-a642-4ce9-869a-6267622dc63d/volumes"
Nov 03 17:22:37.045408 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:22:37.045365    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:22:40.156098 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.156068    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-lb5kg"]
Nov 03 17:22:40.156497 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.156436    5021 cpu_manager.go:414] "containerMap: removing container" podUID="e0b33cb9-a642-4ce9-869a-6267622dc63d" containerName="authorino"
Nov 03 17:22:40.156497 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.156448    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0b33cb9-a642-4ce9-869a-6267622dc63d" containerName="authorino"
Nov 03 17:22:40.156570 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.156515    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="e0b33cb9-a642-4ce9-869a-6267622dc63d" containerName="authorino"
Nov 03 17:22:40.163302 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.163280    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-lb5kg"
Nov 03 17:22:40.219048 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.219013    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-lb5kg"]
Nov 03 17:22:40.221992 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.221960    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhbx6\" (UniqueName: \"kubernetes.io/projected/b4547a2f-d1ef-4d57-8e42-0f0b2da011fb-kube-api-access-fhbx6\") pod \"postgres-7cdbf6dc44-lb5kg\" (UID: \"b4547a2f-d1ef-4d57-8e42-0f0b2da011fb\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-lb5kg"
Nov 03 17:22:40.222162 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.222066    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b4547a2f-d1ef-4d57-8e42-0f0b2da011fb-data\") pod \"postgres-7cdbf6dc44-lb5kg\" (UID: \"b4547a2f-d1ef-4d57-8e42-0f0b2da011fb\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-lb5kg"
Nov 03 17:22:40.238745 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.238721    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 03 17:22:40.263376 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.263350    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 03 17:22:40.263505 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.263418    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-865g8\""
Nov 03 17:22:40.264095 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.264083    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Nov 03 17:22:40.323140 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.323065    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b4547a2f-d1ef-4d57-8e42-0f0b2da011fb-data\") pod \"postgres-7cdbf6dc44-lb5kg\" (UID: \"b4547a2f-d1ef-4d57-8e42-0f0b2da011fb\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-lb5kg"
Nov 03 17:22:40.323291 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.323147    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhbx6\" (UniqueName: \"kubernetes.io/projected/b4547a2f-d1ef-4d57-8e42-0f0b2da011fb-kube-api-access-fhbx6\") pod \"postgres-7cdbf6dc44-lb5kg\" (UID: \"b4547a2f-d1ef-4d57-8e42-0f0b2da011fb\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-lb5kg"
Nov 03 17:22:40.323499 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.323481    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b4547a2f-d1ef-4d57-8e42-0f0b2da011fb-data\") pod \"postgres-7cdbf6dc44-lb5kg\" (UID: \"b4547a2f-d1ef-4d57-8e42-0f0b2da011fb\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-lb5kg"
Nov 03 17:22:40.387485 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.387448    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhbx6\" (UniqueName: \"kubernetes.io/projected/b4547a2f-d1ef-4d57-8e42-0f0b2da011fb-kube-api-access-fhbx6\") pod \"postgres-7cdbf6dc44-lb5kg\" (UID: \"b4547a2f-d1ef-4d57-8e42-0f0b2da011fb\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-lb5kg"
Nov 03 17:22:40.476009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.475973    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-lb5kg"
Nov 03 17:22:40.845372 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:40.845332    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-lb5kg"]
Nov 03 17:22:40.850311 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:22:40.850280    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4547a2f_d1ef_4d57_8e42_0f0b2da011fb.slice/crio-aece47684c93315504b0e7299b0bb14f4e32003912b634460e197d7c08a53d39 WatchSource:0}: Error finding container aece47684c93315504b0e7299b0bb14f4e32003912b634460e197d7c08a53d39: Status 404 returned error can't find the container with id aece47684c93315504b0e7299b0bb14f4e32003912b634460e197d7c08a53d39
Nov 03 17:22:41.794207 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:41.794168    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-lb5kg" event={"ID":"b4547a2f-d1ef-4d57-8e42-0f0b2da011fb","Type":"ContainerStarted","Data":"aece47684c93315504b0e7299b0bb14f4e32003912b634460e197d7c08a53d39"}
Nov 03 17:22:50.844664 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:50.844630    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-lb5kg" event={"ID":"b4547a2f-d1ef-4d57-8e42-0f0b2da011fb","Type":"ContainerStarted","Data":"996f0037a37de3f8744deca17dac0eb084a403e3601ca0ca9785fea6a5871d8b"}
Nov 03 17:22:50.845027 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:50.844693    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-lb5kg"
Nov 03 17:22:50.959427 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:50.959311    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-lb5kg" podStartSLOduration=1.187047703 podStartE2EDuration="10.959297216s" totalImagesPullingTime="9.772249513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:22:50.959283958 +0000 UTC m=+371.160622009" watchObservedRunningTime="2026-11-03 17:22:50.959297216 +0000 UTC m=+371.160635286"
Nov 03 17:22:56.878205 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:22:56.878176    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-lb5kg"
Nov 03 17:23:07.044472 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:23:07.044438    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:23:16.785493 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.785451    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"]
Nov 03 17:23:16.805430 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.805399    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:23:16.846429 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.846392    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"]
Nov 03 17:23:16.853567 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.853537    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr7gl\" (UniqueName: \"kubernetes.io/projected/782d07ab-b807-400c-b2b2-74989c3f84e9-kube-api-access-fr7gl\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-jvcqp\" (UID: \"782d07ab-b807-400c-b2b2-74989c3f84e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:23:16.853701 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.853604    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/782d07ab-b807-400c-b2b2-74989c3f84e9-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-jvcqp\" (UID: \"782d07ab-b807-400c-b2b2-74989c3f84e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:23:16.853751 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.853701    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/782d07ab-b807-400c-b2b2-74989c3f84e9-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-jvcqp\" (UID: \"782d07ab-b807-400c-b2b2-74989c3f84e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:23:16.853751 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.853729    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/782d07ab-b807-400c-b2b2-74989c3f84e9-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-jvcqp\" (UID: \"782d07ab-b807-400c-b2b2-74989c3f84e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:23:16.891576 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.891436    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Nov 03 17:23:16.891576 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.891435    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Nov 03 17:23:16.891576 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.891523    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 03 17:23:16.891576 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.891539    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Nov 03 17:23:16.892110 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.892092    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 03 17:23:16.892110 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.892098    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-r9drz\""
Nov 03 17:23:16.955132 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.955099    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/782d07ab-b807-400c-b2b2-74989c3f84e9-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-jvcqp\" (UID: \"782d07ab-b807-400c-b2b2-74989c3f84e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:23:16.955340 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.955146    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/782d07ab-b807-400c-b2b2-74989c3f84e9-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-jvcqp\" (UID: \"782d07ab-b807-400c-b2b2-74989c3f84e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:23:16.955340 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.955165    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/782d07ab-b807-400c-b2b2-74989c3f84e9-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-jvcqp\" (UID: \"782d07ab-b807-400c-b2b2-74989c3f84e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:23:16.955340 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.955215    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr7gl\" (UniqueName: \"kubernetes.io/projected/782d07ab-b807-400c-b2b2-74989c3f84e9-kube-api-access-fr7gl\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-jvcqp\" (UID: \"782d07ab-b807-400c-b2b2-74989c3f84e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:23:16.955340 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:23:16.955218    5021 configmap.go:193] Couldn't get configMap opendatahub/usage-tenancy-proxy-source: configmap "usage-tenancy-proxy-source" not found
Nov 03 17:23:16.955340 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:23:16.955279    5021 secret.go:189] Couldn't get secret opendatahub/usage-logs-tenancy-proxy-tls: secret "usage-logs-tenancy-proxy-tls" not found
Nov 03 17:23:16.955340 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:23:16.955344    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/782d07ab-b807-400c-b2b2-74989c3f84e9-proxy-source podName:782d07ab-b807-400c-b2b2-74989c3f84e9 nodeName:}" failed. No retries permitted until 2026-11-03 17:23:17.455320805 +0000 UTC m=+397.656658854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-source" (UniqueName: "kubernetes.io/configmap/782d07ab-b807-400c-b2b2-74989c3f84e9-proxy-source") pod "usage-logs-tenancy-proxy-9c5d49bcd-jvcqp" (UID: "782d07ab-b807-400c-b2b2-74989c3f84e9") : configmap "usage-tenancy-proxy-source" not found
Nov 03 17:23:16.955639 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:23:16.955358    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/782d07ab-b807-400c-b2b2-74989c3f84e9-tls-cert podName:782d07ab-b807-400c-b2b2-74989c3f84e9 nodeName:}" failed. No retries permitted until 2026-11-03 17:23:17.455352616 +0000 UTC m=+397.656690647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-cert" (UniqueName: "kubernetes.io/secret/782d07ab-b807-400c-b2b2-74989c3f84e9-tls-cert") pod "usage-logs-tenancy-proxy-9c5d49bcd-jvcqp" (UID: "782d07ab-b807-400c-b2b2-74989c3f84e9") : secret "usage-logs-tenancy-proxy-tls" not found
Nov 03 17:23:16.955888 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:16.955858    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/782d07ab-b807-400c-b2b2-74989c3f84e9-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-jvcqp\" (UID: \"782d07ab-b807-400c-b2b2-74989c3f84e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:23:17.014243 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:17.014205    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr7gl\" (UniqueName: \"kubernetes.io/projected/782d07ab-b807-400c-b2b2-74989c3f84e9-kube-api-access-fr7gl\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-jvcqp\" (UID: \"782d07ab-b807-400c-b2b2-74989c3f84e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:23:17.460698 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:17.460664    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/782d07ab-b807-400c-b2b2-74989c3f84e9-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-jvcqp\" (UID: \"782d07ab-b807-400c-b2b2-74989c3f84e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:23:17.460901 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:17.460821    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/782d07ab-b807-400c-b2b2-74989c3f84e9-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-jvcqp\" (UID: \"782d07ab-b807-400c-b2b2-74989c3f84e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:23:17.461859 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:17.461838    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/782d07ab-b807-400c-b2b2-74989c3f84e9-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-jvcqp\" (UID: \"782d07ab-b807-400c-b2b2-74989c3f84e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:23:17.463099 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:17.463081    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/782d07ab-b807-400c-b2b2-74989c3f84e9-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-jvcqp\" (UID: \"782d07ab-b807-400c-b2b2-74989c3f84e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:23:17.717244 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:17.717145    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:23:18.087677 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:18.087645    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"]
Nov 03 17:23:18.092757 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:23:18.092729    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod782d07ab_b807_400c_b2b2_74989c3f84e9.slice/crio-a8fc11fc0a7105ec0e7d15627349a571c8824b1e74c0feb454be17354c813c60 WatchSource:0}: Error finding container a8fc11fc0a7105ec0e7d15627349a571c8824b1e74c0feb454be17354c813c60: Status 404 returned error can't find the container with id a8fc11fc0a7105ec0e7d15627349a571c8824b1e74c0feb454be17354c813c60
Nov 03 17:23:18.979501 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:18.979423    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp" event={"ID":"782d07ab-b807-400c-b2b2-74989c3f84e9","Type":"ContainerStarted","Data":"a8fc11fc0a7105ec0e7d15627349a571c8824b1e74c0feb454be17354c813c60"}
Nov 03 17:23:19.994548 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:19.994513    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-kfwnf"]
Nov 03 17:23:19.998798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:19.998774    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-kfwnf"
Nov 03 17:23:20.058900 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.058870    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-kfwnf"]
Nov 03 17:23:20.061135 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.061110    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Nov 03 17:23:20.061318 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.061295    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-kfwnj\""
Nov 03 17:23:20.084784 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.084746    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/449ee7b6-e6dd-4aef-933c-722a0eb63ae1-tls-certs\") pod \"model-serving-api-75bd89fdfc-kfwnf\" (UID: \"449ee7b6-e6dd-4aef-933c-722a0eb63ae1\") " pod="opendatahub/model-serving-api-75bd89fdfc-kfwnf"
Nov 03 17:23:20.084784 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.084780    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qkkr\" (UniqueName: \"kubernetes.io/projected/449ee7b6-e6dd-4aef-933c-722a0eb63ae1-kube-api-access-2qkkr\") pod \"model-serving-api-75bd89fdfc-kfwnf\" (UID: \"449ee7b6-e6dd-4aef-933c-722a0eb63ae1\") " pod="opendatahub/model-serving-api-75bd89fdfc-kfwnf"
Nov 03 17:23:20.112306 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.112271    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-sg7cz"]
Nov 03 17:23:20.115860 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.115838    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-sg7cz"
Nov 03 17:23:20.170876 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.170837    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-sg7cz"]
Nov 03 17:23:20.185717 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.185679    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/321a5ab2-29da-497d-83ac-68121f5fe200-cert\") pod \"odh-model-controller-769875db56-sg7cz\" (UID: \"321a5ab2-29da-497d-83ac-68121f5fe200\") " pod="opendatahub/odh-model-controller-769875db56-sg7cz"
Nov 03 17:23:20.185918 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.185731    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/321a5ab2-29da-497d-83ac-68121f5fe200-metrics-certs\") pod \"odh-model-controller-769875db56-sg7cz\" (UID: \"321a5ab2-29da-497d-83ac-68121f5fe200\") " pod="opendatahub/odh-model-controller-769875db56-sg7cz"
Nov 03 17:23:20.185918 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.185848    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/449ee7b6-e6dd-4aef-933c-722a0eb63ae1-tls-certs\") pod \"model-serving-api-75bd89fdfc-kfwnf\" (UID: \"449ee7b6-e6dd-4aef-933c-722a0eb63ae1\") " pod="opendatahub/model-serving-api-75bd89fdfc-kfwnf"
Nov 03 17:23:20.185918 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.185897    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qkkr\" (UniqueName: \"kubernetes.io/projected/449ee7b6-e6dd-4aef-933c-722a0eb63ae1-kube-api-access-2qkkr\") pod \"model-serving-api-75bd89fdfc-kfwnf\" (UID: \"449ee7b6-e6dd-4aef-933c-722a0eb63ae1\") " pod="opendatahub/model-serving-api-75bd89fdfc-kfwnf"
Nov 03 17:23:20.186112 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.185979    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8vjz\" (UniqueName: \"kubernetes.io/projected/321a5ab2-29da-497d-83ac-68121f5fe200-kube-api-access-t8vjz\") pod \"odh-model-controller-769875db56-sg7cz\" (UID: \"321a5ab2-29da-497d-83ac-68121f5fe200\") " pod="opendatahub/odh-model-controller-769875db56-sg7cz"
Nov 03 17:23:20.188376 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.188351    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/449ee7b6-e6dd-4aef-933c-722a0eb63ae1-tls-certs\") pod \"model-serving-api-75bd89fdfc-kfwnf\" (UID: \"449ee7b6-e6dd-4aef-933c-722a0eb63ae1\") " pod="opendatahub/model-serving-api-75bd89fdfc-kfwnf"
Nov 03 17:23:20.254977 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.254944    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qkkr\" (UniqueName: \"kubernetes.io/projected/449ee7b6-e6dd-4aef-933c-722a0eb63ae1-kube-api-access-2qkkr\") pod \"model-serving-api-75bd89fdfc-kfwnf\" (UID: \"449ee7b6-e6dd-4aef-933c-722a0eb63ae1\") " pod="opendatahub/model-serving-api-75bd89fdfc-kfwnf"
Nov 03 17:23:20.257827 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.257800    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Nov 03 17:23:20.257961 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.257852    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ls6vj\""
Nov 03 17:23:20.257961 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.257945    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Nov 03 17:23:20.286589 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.286557    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/321a5ab2-29da-497d-83ac-68121f5fe200-metrics-certs\") pod \"odh-model-controller-769875db56-sg7cz\" (UID: \"321a5ab2-29da-497d-83ac-68121f5fe200\") " pod="opendatahub/odh-model-controller-769875db56-sg7cz"
Nov 03 17:23:20.286741 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.286638    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8vjz\" (UniqueName: \"kubernetes.io/projected/321a5ab2-29da-497d-83ac-68121f5fe200-kube-api-access-t8vjz\") pod \"odh-model-controller-769875db56-sg7cz\" (UID: \"321a5ab2-29da-497d-83ac-68121f5fe200\") " pod="opendatahub/odh-model-controller-769875db56-sg7cz"
Nov 03 17:23:20.286741 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.286699    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/321a5ab2-29da-497d-83ac-68121f5fe200-cert\") pod \"odh-model-controller-769875db56-sg7cz\" (UID: \"321a5ab2-29da-497d-83ac-68121f5fe200\") " pod="opendatahub/odh-model-controller-769875db56-sg7cz"
Nov 03 17:23:20.289021 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.288995    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/321a5ab2-29da-497d-83ac-68121f5fe200-cert\") pod \"odh-model-controller-769875db56-sg7cz\" (UID: \"321a5ab2-29da-497d-83ac-68121f5fe200\") " pod="opendatahub/odh-model-controller-769875db56-sg7cz"
Nov 03 17:23:20.289021 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.289009    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/321a5ab2-29da-497d-83ac-68121f5fe200-metrics-certs\") pod \"odh-model-controller-769875db56-sg7cz\" (UID: \"321a5ab2-29da-497d-83ac-68121f5fe200\") " pod="opendatahub/odh-model-controller-769875db56-sg7cz"
Nov 03 17:23:20.311941 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.311913    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-kfwnf"
Nov 03 17:23:20.346174 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.346144    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8vjz\" (UniqueName: \"kubernetes.io/projected/321a5ab2-29da-497d-83ac-68121f5fe200-kube-api-access-t8vjz\") pod \"odh-model-controller-769875db56-sg7cz\" (UID: \"321a5ab2-29da-497d-83ac-68121f5fe200\") " pod="opendatahub/odh-model-controller-769875db56-sg7cz"
Nov 03 17:23:20.429712 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.429678    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-sg7cz"
Nov 03 17:23:20.682538 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.682463    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-kfwnf"]
Nov 03 17:23:20.688269 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:23:20.688239    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449ee7b6_e6dd_4aef_933c_722a0eb63ae1.slice/crio-15819399e76a9a817f98ef4c63991ea64a0a7cce1d8fc0b4849dd28d6c59b4cf WatchSource:0}: Error finding container 15819399e76a9a817f98ef4c63991ea64a0a7cce1d8fc0b4849dd28d6c59b4cf: Status 404 returned error can't find the container with id 15819399e76a9a817f98ef4c63991ea64a0a7cce1d8fc0b4849dd28d6c59b4cf
Nov 03 17:23:20.803171 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.803142    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-sg7cz"]
Nov 03 17:23:20.809293 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:23:20.809257    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod321a5ab2_29da_497d_83ac_68121f5fe200.slice/crio-9c8d848ed51a5759f565bb726535e68f72972e23114726e723e46ed1c89a28ef WatchSource:0}: Error finding container 9c8d848ed51a5759f565bb726535e68f72972e23114726e723e46ed1c89a28ef: Status 404 returned error can't find the container with id 9c8d848ed51a5759f565bb726535e68f72972e23114726e723e46ed1c89a28ef
Nov 03 17:23:20.989684 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.989587    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-kfwnf" event={"ID":"449ee7b6-e6dd-4aef-933c-722a0eb63ae1","Type":"ContainerStarted","Data":"15819399e76a9a817f98ef4c63991ea64a0a7cce1d8fc0b4849dd28d6c59b4cf"}
Nov 03 17:23:20.990890 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:20.990863    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-sg7cz" event={"ID":"321a5ab2-29da-497d-83ac-68121f5fe200","Type":"ContainerStarted","Data":"9c8d848ed51a5759f565bb726535e68f72972e23114726e723e46ed1c89a28ef"}
Nov 03 17:23:25.029522 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:25.029482    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-kfwnf" event={"ID":"449ee7b6-e6dd-4aef-933c-722a0eb63ae1","Type":"ContainerStarted","Data":"4b120c66ad594488450e1d5768d9a75e3ed27f4a0aa4d857155c5e0d1e8f30d5"}
Nov 03 17:23:25.030016 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:25.029648    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-kfwnf"
Nov 03 17:23:25.142587 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:25.142521    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-kfwnf" podStartSLOduration=2.571519865 podStartE2EDuration="6.14250647s" totalImagesPullingTime="3.570986605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:23:25.141565753 +0000 UTC m=+405.342903805" watchObservedRunningTime="2026-11-03 17:23:25.14250647 +0000 UTC m=+405.343844522"
Nov 03 17:23:26.042329 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:26.042286    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-sg7cz" event={"ID":"321a5ab2-29da-497d-83ac-68121f5fe200","Type":"ContainerStarted","Data":"1a75c6355839a695f8b8ae6f2e2d070e74e1dc536c883c7466a57e30f84af703"}
Nov 03 17:23:26.042772 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:26.042400    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-sg7cz"
Nov 03 17:23:26.157094 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:26.157040    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-sg7cz" podStartSLOduration=1.775011944 podStartE2EDuration="6.157023989s" totalImagesPullingTime="4.382012045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:23:26.156576934 +0000 UTC m=+406.357914988" watchObservedRunningTime="2026-11-03 17:23:26.157023989 +0000 UTC m=+406.358362040"
Nov 03 17:23:34.091146 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:34.091106    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp" event={"ID":"782d07ab-b807-400c-b2b2-74989c3f84e9","Type":"ContainerStarted","Data":"edf79906d6aa0b2dcc4340255260676482f6c60e828a56a2923747c966d31063"}
Nov 03 17:23:34.091591 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:34.091281    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:23:34.204879 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:34.204818    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp" podStartSLOduration=2.864921176 podStartE2EDuration="18.204805005s" totalImagesPullingTime="15.339883829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:23:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:23:34.20352769 +0000 UTC m=+414.404865739" watchObservedRunningTime="2026-11-03 17:23:34.204805005 +0000 UTC m=+414.406143057"
Nov 03 17:23:36.046053 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:36.046025    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-kfwnf"
Nov 03 17:23:37.045679 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:23:37.045638    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:23:37.050923 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:37.050895    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-sg7cz"
Nov 03 17:23:45.102869 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:23:45.102837    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jvcqp"
Nov 03 17:24:04.053747 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.053710    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-cwq6g"]
Nov 03 17:24:04.066079 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.066057    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-cwq6g"
Nov 03 17:24:04.099791 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.099758    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp646\" (UniqueName: \"kubernetes.io/projected/ed5b3bfd-9c7f-40ea-8839-1cda896614e0-kube-api-access-vp646\") pod \"authorino-6f6944bcdd-cwq6g\" (UID: \"ed5b3bfd-9c7f-40ea-8839-1cda896614e0\") " pod="kuadrant-system/authorino-6f6944bcdd-cwq6g"
Nov 03 17:24:04.108733 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.108701    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-cwq6g"]
Nov 03 17:24:04.200647 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.200610    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp646\" (UniqueName: \"kubernetes.io/projected/ed5b3bfd-9c7f-40ea-8839-1cda896614e0-kube-api-access-vp646\") pod \"authorino-6f6944bcdd-cwq6g\" (UID: \"ed5b3bfd-9c7f-40ea-8839-1cda896614e0\") " pod="kuadrant-system/authorino-6f6944bcdd-cwq6g"
Nov 03 17:24:04.269998 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.269967    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"]
Nov 03 17:24:04.271579 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.271560    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp646\" (UniqueName: \"kubernetes.io/projected/ed5b3bfd-9c7f-40ea-8839-1cda896614e0-kube-api-access-vp646\") pod \"authorino-6f6944bcdd-cwq6g\" (UID: \"ed5b3bfd-9c7f-40ea-8839-1cda896614e0\") " pod="kuadrant-system/authorino-6f6944bcdd-cwq6g"
Nov 03 17:24:04.272515 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.272498    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 17:24:04.301954 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.301926    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be247f01-f07d-4817-b877-d040866e420e-maas-api-tls\") pod \"maas-api-d6b5cbff-lmrkv\" (UID: \"be247f01-f07d-4817-b877-d040866e420e\") " pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 17:24:04.302067 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.301970    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be247f01-f07d-4817-b877-d040866e420e-metrics-certs\") pod \"maas-api-d6b5cbff-lmrkv\" (UID: \"be247f01-f07d-4817-b877-d040866e420e\") " pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 17:24:04.302067 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.302053    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wld7g\" (UniqueName: \"kubernetes.io/projected/be247f01-f07d-4817-b877-d040866e420e-kube-api-access-wld7g\") pod \"maas-api-d6b5cbff-lmrkv\" (UID: \"be247f01-f07d-4817-b877-d040866e420e\") " pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 17:24:04.302137 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.302086    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be247f01-f07d-4817-b877-d040866e420e-openshift-service-ca\") pod \"maas-api-d6b5cbff-lmrkv\" (UID: \"be247f01-f07d-4817-b877-d040866e420e\") " pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 17:24:04.329423 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.329349    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 03 17:24:04.376260 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.376217    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-cwq6g"
Nov 03 17:24:04.381272 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.381244    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 03 17:24:04.383995 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.383969    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"]
Nov 03 17:24:04.402745 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.402717    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be247f01-f07d-4817-b877-d040866e420e-metrics-certs\") pod \"maas-api-d6b5cbff-lmrkv\" (UID: \"be247f01-f07d-4817-b877-d040866e420e\") " pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 17:24:04.402897 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.402769    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wld7g\" (UniqueName: \"kubernetes.io/projected/be247f01-f07d-4817-b877-d040866e420e-kube-api-access-wld7g\") pod \"maas-api-d6b5cbff-lmrkv\" (UID: \"be247f01-f07d-4817-b877-d040866e420e\") " pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 17:24:04.402897 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.402795    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be247f01-f07d-4817-b877-d040866e420e-openshift-service-ca\") pod \"maas-api-d6b5cbff-lmrkv\" (UID: \"be247f01-f07d-4817-b877-d040866e420e\") " pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 17:24:04.402897 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.402841    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be247f01-f07d-4817-b877-d040866e420e-maas-api-tls\") pod \"maas-api-d6b5cbff-lmrkv\" (UID: \"be247f01-f07d-4817-b877-d040866e420e\") " pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 17:24:04.403558 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.403532    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be247f01-f07d-4817-b877-d040866e420e-openshift-service-ca\") pod \"maas-api-d6b5cbff-lmrkv\" (UID: \"be247f01-f07d-4817-b877-d040866e420e\") " pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 17:24:04.405138 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.405116    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be247f01-f07d-4817-b877-d040866e420e-maas-api-tls\") pod \"maas-api-d6b5cbff-lmrkv\" (UID: \"be247f01-f07d-4817-b877-d040866e420e\") " pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 17:24:04.405270 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.405215    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be247f01-f07d-4817-b877-d040866e420e-metrics-certs\") pod \"maas-api-d6b5cbff-lmrkv\" (UID: \"be247f01-f07d-4817-b877-d040866e420e\") " pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 17:24:04.429076 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.428802    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-r6cmh\""
Nov 03 17:24:04.466819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.466792    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wld7g\" (UniqueName: \"kubernetes.io/projected/be247f01-f07d-4817-b877-d040866e420e-kube-api-access-wld7g\") pod \"maas-api-d6b5cbff-lmrkv\" (UID: \"be247f01-f07d-4817-b877-d040866e420e\") " pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 17:24:04.476355 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.476329    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-cwq6g"]
Nov 03 17:24:04.523721 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.523692    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64cf86db8d-2vl7g"]
Nov 03 17:24:04.527133 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.527111    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64cf86db8d-2vl7g"
Nov 03 17:24:04.581428 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.581333    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64cf86db8d-2vl7g"]
Nov 03 17:24:04.590269 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.590239    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 17:24:04.604685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.604645    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6n7h\" (UniqueName: \"kubernetes.io/projected/e6a13559-d257-457c-81d3-22a098395f73-kube-api-access-g6n7h\") pod \"authorino-64cf86db8d-2vl7g\" (UID: \"e6a13559-d257-457c-81d3-22a098395f73\") " pod="kuadrant-system/authorino-64cf86db8d-2vl7g"
Nov 03 17:24:04.705823 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.705789    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6n7h\" (UniqueName: \"kubernetes.io/projected/e6a13559-d257-457c-81d3-22a098395f73-kube-api-access-g6n7h\") pod \"authorino-64cf86db8d-2vl7g\" (UID: \"e6a13559-d257-457c-81d3-22a098395f73\") " pod="kuadrant-system/authorino-64cf86db8d-2vl7g"
Nov 03 17:24:04.760325 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.760302    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-cwq6g"]
Nov 03 17:24:04.762392 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:24:04.762359    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded5b3bfd_9c7f_40ea_8839_1cda896614e0.slice/crio-6276e4f715b1162ebf6b870d31165f7fe25df9d49864a4e8cb9f8a9bb157323d WatchSource:0}: Error finding container 6276e4f715b1162ebf6b870d31165f7fe25df9d49864a4e8cb9f8a9bb157323d: Status 404 returned error can't find the container with id 6276e4f715b1162ebf6b870d31165f7fe25df9d49864a4e8cb9f8a9bb157323d
Nov 03 17:24:04.767532 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.767508    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64cf86db8d-2vl7g"]
Nov 03 17:24:04.767725 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:24:04.767709    5021 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-g6n7h], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-64cf86db8d-2vl7g" podUID="e6a13559-d257-457c-81d3-22a098395f73"
Nov 03 17:24:04.775799 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.775775    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6n7h\" (UniqueName: \"kubernetes.io/projected/e6a13559-d257-457c-81d3-22a098395f73-kube-api-access-g6n7h\") pod \"authorino-64cf86db8d-2vl7g\" (UID: \"e6a13559-d257-457c-81d3-22a098395f73\") " pod="kuadrant-system/authorino-64cf86db8d-2vl7g"
Nov 03 17:24:04.795383 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.795362    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c6844cdb-jwlb4"]
Nov 03 17:24:04.798092 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.798076    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c6844cdb-jwlb4"
Nov 03 17:24:04.852908 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.852847    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Nov 03 17:24:04.859980 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.859948    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c6844cdb-jwlb4"]
Nov 03 17:24:04.907282 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.907253    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65b3b20a-a761-435a-994d-281db488621a-tls-cert\") pod \"authorino-6c6844cdb-jwlb4\" (UID: \"65b3b20a-a761-435a-994d-281db488621a\") " pod="kuadrant-system/authorino-6c6844cdb-jwlb4"
Nov 03 17:24:04.907422 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.907386    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2nlx\" (UniqueName: \"kubernetes.io/projected/65b3b20a-a761-435a-994d-281db488621a-kube-api-access-d2nlx\") pod \"authorino-6c6844cdb-jwlb4\" (UID: \"65b3b20a-a761-435a-994d-281db488621a\") " pod="kuadrant-system/authorino-6c6844cdb-jwlb4"
Nov 03 17:24:04.968832 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:04.968799    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"]
Nov 03 17:24:04.969496 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:24:04.969468    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe247f01_f07d_4817_b877_d040866e420e.slice/crio-5ae3379ff3784c9b9030c331edbdd8277b865531656202cade4236fb8c8013f4 WatchSource:0}: Error finding container 5ae3379ff3784c9b9030c331edbdd8277b865531656202cade4236fb8c8013f4: Status 404 returned error can't find the container with id 5ae3379ff3784c9b9030c331edbdd8277b865531656202cade4236fb8c8013f4
Nov 03 17:24:05.008301 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:05.008270    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2nlx\" (UniqueName: \"kubernetes.io/projected/65b3b20a-a761-435a-994d-281db488621a-kube-api-access-d2nlx\") pod \"authorino-6c6844cdb-jwlb4\" (UID: \"65b3b20a-a761-435a-994d-281db488621a\") " pod="kuadrant-system/authorino-6c6844cdb-jwlb4"
Nov 03 17:24:05.008427 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:05.008321    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65b3b20a-a761-435a-994d-281db488621a-tls-cert\") pod \"authorino-6c6844cdb-jwlb4\" (UID: \"65b3b20a-a761-435a-994d-281db488621a\") " pod="kuadrant-system/authorino-6c6844cdb-jwlb4"
Nov 03 17:24:05.011402 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:05.011375    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65b3b20a-a761-435a-994d-281db488621a-tls-cert\") pod \"authorino-6c6844cdb-jwlb4\" (UID: \"65b3b20a-a761-435a-994d-281db488621a\") " pod="kuadrant-system/authorino-6c6844cdb-jwlb4"
Nov 03 17:24:05.073876 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:05.073837    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2nlx\" (UniqueName: \"kubernetes.io/projected/65b3b20a-a761-435a-994d-281db488621a-kube-api-access-d2nlx\") pod \"authorino-6c6844cdb-jwlb4\" (UID: \"65b3b20a-a761-435a-994d-281db488621a\") " pod="kuadrant-system/authorino-6c6844cdb-jwlb4"
Nov 03 17:24:05.108417 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:05.108356    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c6844cdb-jwlb4"
Nov 03 17:24:05.238885 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:05.238842    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv" event={"ID":"be247f01-f07d-4817-b877-d040866e420e","Type":"ContainerStarted","Data":"5ae3379ff3784c9b9030c331edbdd8277b865531656202cade4236fb8c8013f4"}
Nov 03 17:24:05.240109 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:05.240084    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-cwq6g" event={"ID":"ed5b3bfd-9c7f-40ea-8839-1cda896614e0","Type":"ContainerStarted","Data":"6276e4f715b1162ebf6b870d31165f7fe25df9d49864a4e8cb9f8a9bb157323d"}
Nov 03 17:24:05.240205 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:05.240111    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64cf86db8d-2vl7g"
Nov 03 17:24:05.245825 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:05.245805    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64cf86db8d-2vl7g"
Nov 03 17:24:05.310505 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:05.310471    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e6a13559-d257-457c-81d3-22a098395f73-kube-api-access-g6n7h\" (UniqueName: \"kubernetes.io/projected/e6a13559-d257-457c-81d3-22a098395f73-kube-api-access-g6n7h\") pod \"e6a13559-d257-457c-81d3-22a098395f73\" (UID: \"e6a13559-d257-457c-81d3-22a098395f73\") "
Nov 03 17:24:05.312641 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:05.312607    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6a13559-d257-457c-81d3-22a098395f73-kube-api-access-g6n7h" pod "e6a13559-d257-457c-81d3-22a098395f73" (UID: "e6a13559-d257-457c-81d3-22a098395f73"). InnerVolumeSpecName "kube-api-access-g6n7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:24:05.412159 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:05.412079    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6n7h\" (UniqueName: \"kubernetes.io/projected/e6a13559-d257-457c-81d3-22a098395f73-kube-api-access-g6n7h\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:24:05.479923 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:05.479892    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c6844cdb-jwlb4"]
Nov 03 17:24:05.480733 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:24:05.480707    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65b3b20a_a761_435a_994d_281db488621a.slice/crio-1cc1530b20d6bc72e49adf6acae61f9fb8c48fe02b200e368707ae580c35ac88 WatchSource:0}: Error finding container 1cc1530b20d6bc72e49adf6acae61f9fb8c48fe02b200e368707ae580c35ac88: Status 404 returned error can't find the container with id 1cc1530b20d6bc72e49adf6acae61f9fb8c48fe02b200e368707ae580c35ac88
Nov 03 17:24:06.250080 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:06.250040    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c6844cdb-jwlb4" event={"ID":"65b3b20a-a761-435a-994d-281db488621a","Type":"ContainerStarted","Data":"1cc1530b20d6bc72e49adf6acae61f9fb8c48fe02b200e368707ae580c35ac88"}
Nov 03 17:24:06.250559 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:06.250094    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64cf86db8d-2vl7g"
Nov 03 17:24:06.487871 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:06.487820    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64cf86db8d-2vl7g"]
Nov 03 17:24:06.490628 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:06.490602    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-64cf86db8d-2vl7g"]
Nov 03 17:24:07.050472 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:24:07.050430    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:24:07.259307 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:07.259268    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c6844cdb-jwlb4" event={"ID":"65b3b20a-a761-435a-994d-281db488621a","Type":"ContainerStarted","Data":"0f0619d66cbea205150be110cd7b81bc7fe6b0c865daf287d2da849ecf7412bf"}
Nov 03 17:24:07.261924 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:07.261884    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-cwq6g" event={"ID":"ed5b3bfd-9c7f-40ea-8839-1cda896614e0","Type":"ContainerStarted","Data":"e810f5b0787cbfec2e513693decf7cc338eb2985284667b6858b35e2cfed6851"}
Nov 03 17:24:07.261924 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:07.261916    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6944bcdd-cwq6g" podUID="ed5b3bfd-9c7f-40ea-8839-1cda896614e0" containerName="authorino" containerID="cri-o://e810f5b0787cbfec2e513693decf7cc338eb2985284667b6858b35e2cfed6851" gracePeriod=30
Nov 03 17:24:07.338379 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:24:07.338312    5021 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded5b3bfd_9c7f_40ea_8839_1cda896614e0.slice/crio-conmon-e810f5b0787cbfec2e513693decf7cc338eb2985284667b6858b35e2cfed6851.scope\": RecentStats: unable to find data in memory cache]"
Nov 03 17:24:07.382153 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:07.382095    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6c6844cdb-jwlb4" podStartSLOduration=1.979463043 podStartE2EDuration="3.382072863s" totalImagesPullingTime="1.40260982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:24:07.379526166 +0000 UTC m=+447.580864219" watchObservedRunningTime="2026-11-03 17:24:07.382072863 +0000 UTC m=+447.583410916"
Nov 03 17:24:07.419380 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:07.419345    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-tqmq6"]
Nov 03 17:24:07.419614 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:07.419568    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-tqmq6" podUID="29854459-4fcb-4a1a-9894-78d7abdc45b9" containerName="authorino" containerID="cri-o://d50ceaaf738119e8710c3aa47781c377decd6b2dd82c90635e16ad60c167a76b" gracePeriod=30
Nov 03 17:24:07.554619 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:07.554586    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-cwq6g"
Nov 03 17:24:07.635930 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:07.635896    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ed5b3bfd-9c7f-40ea-8839-1cda896614e0-kube-api-access-vp646\" (UniqueName: \"kubernetes.io/projected/ed5b3bfd-9c7f-40ea-8839-1cda896614e0-kube-api-access-vp646\") pod \"ed5b3bfd-9c7f-40ea-8839-1cda896614e0\" (UID: \"ed5b3bfd-9c7f-40ea-8839-1cda896614e0\") "
Nov 03 17:24:07.636113 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:07.635917    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6944bcdd-cwq6g" podStartSLOduration=1.9112511030000001 podStartE2EDuration="3.635788979s" totalImagesPullingTime="1.724537876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:24:07.506276656 +0000 UTC m=+447.707614712" watchObservedRunningTime="2026-11-03 17:24:07.635788979 +0000 UTC m=+447.837127024"
Nov 03 17:24:07.641566 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:07.641511    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed5b3bfd-9c7f-40ea-8839-1cda896614e0-kube-api-access-vp646" pod "ed5b3bfd-9c7f-40ea-8839-1cda896614e0" (UID: "ed5b3bfd-9c7f-40ea-8839-1cda896614e0"). InnerVolumeSpecName "kube-api-access-vp646". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:24:07.686193 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:07.686161    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-tqmq6"
Nov 03 17:24:07.737320 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:07.737281    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29854459-4fcb-4a1a-9894-78d7abdc45b9-kube-api-access-p85lz\" (UniqueName: \"kubernetes.io/projected/29854459-4fcb-4a1a-9894-78d7abdc45b9-kube-api-access-p85lz\") pod \"29854459-4fcb-4a1a-9894-78d7abdc45b9\" (UID: \"29854459-4fcb-4a1a-9894-78d7abdc45b9\") "
Nov 03 17:24:07.737523 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:07.737505    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp646\" (UniqueName: \"kubernetes.io/projected/ed5b3bfd-9c7f-40ea-8839-1cda896614e0-kube-api-access-vp646\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:24:07.739744 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:07.739711    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29854459-4fcb-4a1a-9894-78d7abdc45b9-kube-api-access-p85lz" pod "29854459-4fcb-4a1a-9894-78d7abdc45b9" (UID: "29854459-4fcb-4a1a-9894-78d7abdc45b9"). InnerVolumeSpecName "kube-api-access-p85lz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:24:07.839069 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:07.838979    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p85lz\" (UniqueName: \"kubernetes.io/projected/29854459-4fcb-4a1a-9894-78d7abdc45b9-kube-api-access-p85lz\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:24:08.002837 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.002758    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e6a13559-d257-457c-81d3-22a098395f73" path="/var/lib/kubelet/pods/e6a13559-d257-457c-81d3-22a098395f73/volumes"
Nov 03 17:24:08.268621 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.268586    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv" event={"ID":"be247f01-f07d-4817-b877-d040866e420e","Type":"ContainerStarted","Data":"4996718da077ceff5e8d1326eef7c2275f1222a4f1cce72d3df682166ff7271a"}
Nov 03 17:24:08.269063 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.268666    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 17:24:08.269935 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.269908    5021 generic.go:356] "Generic (PLEG): container finished" podID="ed5b3bfd-9c7f-40ea-8839-1cda896614e0" containerID="e810f5b0787cbfec2e513693decf7cc338eb2985284667b6858b35e2cfed6851" exitCode=0
Nov 03 17:24:08.270067 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.269940    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-cwq6g"
Nov 03 17:24:08.270067 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.269990    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-cwq6g" event={"ID":"ed5b3bfd-9c7f-40ea-8839-1cda896614e0","Type":"ContainerDied","Data":"e810f5b0787cbfec2e513693decf7cc338eb2985284667b6858b35e2cfed6851"}
Nov 03 17:24:08.270067 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.270038    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-cwq6g" event={"ID":"ed5b3bfd-9c7f-40ea-8839-1cda896614e0","Type":"ContainerDied","Data":"6276e4f715b1162ebf6b870d31165f7fe25df9d49864a4e8cb9f8a9bb157323d"}
Nov 03 17:24:08.270067 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.270058    5021 scope.go:122] "RemoveContainer" containerID="e810f5b0787cbfec2e513693decf7cc338eb2985284667b6858b35e2cfed6851"
Nov 03 17:24:08.271475 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.271451    5021 generic.go:356] "Generic (PLEG): container finished" podID="29854459-4fcb-4a1a-9894-78d7abdc45b9" containerID="d50ceaaf738119e8710c3aa47781c377decd6b2dd82c90635e16ad60c167a76b" exitCode=0
Nov 03 17:24:08.271566 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.271484    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-tqmq6" event={"ID":"29854459-4fcb-4a1a-9894-78d7abdc45b9","Type":"ContainerDied","Data":"d50ceaaf738119e8710c3aa47781c377decd6b2dd82c90635e16ad60c167a76b"}
Nov 03 17:24:08.271566 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.271502    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-tqmq6"
Nov 03 17:24:08.271566 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.271522    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-tqmq6" event={"ID":"29854459-4fcb-4a1a-9894-78d7abdc45b9","Type":"ContainerDied","Data":"bf61d060388548117a5ead3a354d6073260e7e0719d275e17054803cc1e8d9c9"}
Nov 03 17:24:08.279192 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.279174    5021 scope.go:122] "RemoveContainer" containerID="e810f5b0787cbfec2e513693decf7cc338eb2985284667b6858b35e2cfed6851"
Nov 03 17:24:08.279465 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:24:08.279443    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e810f5b0787cbfec2e513693decf7cc338eb2985284667b6858b35e2cfed6851\": container with ID starting with e810f5b0787cbfec2e513693decf7cc338eb2985284667b6858b35e2cfed6851 not found: ID does not exist" containerID="e810f5b0787cbfec2e513693decf7cc338eb2985284667b6858b35e2cfed6851"
Nov 03 17:24:08.279548 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.279474    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e810f5b0787cbfec2e513693decf7cc338eb2985284667b6858b35e2cfed6851"} err="failed to get container status \"e810f5b0787cbfec2e513693decf7cc338eb2985284667b6858b35e2cfed6851\": rpc error: code = NotFound desc = could not find container \"e810f5b0787cbfec2e513693decf7cc338eb2985284667b6858b35e2cfed6851\": container with ID starting with e810f5b0787cbfec2e513693decf7cc338eb2985284667b6858b35e2cfed6851 not found: ID does not exist"
Nov 03 17:24:08.279548 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.279493    5021 scope.go:122] "RemoveContainer" containerID="d50ceaaf738119e8710c3aa47781c377decd6b2dd82c90635e16ad60c167a76b"
Nov 03 17:24:08.287481 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.287459    5021 scope.go:122] "RemoveContainer" containerID="d50ceaaf738119e8710c3aa47781c377decd6b2dd82c90635e16ad60c167a76b"
Nov 03 17:24:08.287759 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:24:08.287735    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d50ceaaf738119e8710c3aa47781c377decd6b2dd82c90635e16ad60c167a76b\": container with ID starting with d50ceaaf738119e8710c3aa47781c377decd6b2dd82c90635e16ad60c167a76b not found: ID does not exist" containerID="d50ceaaf738119e8710c3aa47781c377decd6b2dd82c90635e16ad60c167a76b"
Nov 03 17:24:08.287824 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.287767    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d50ceaaf738119e8710c3aa47781c377decd6b2dd82c90635e16ad60c167a76b"} err="failed to get container status \"d50ceaaf738119e8710c3aa47781c377decd6b2dd82c90635e16ad60c167a76b\": rpc error: code = NotFound desc = could not find container \"d50ceaaf738119e8710c3aa47781c377decd6b2dd82c90635e16ad60c167a76b\": container with ID starting with d50ceaaf738119e8710c3aa47781c377decd6b2dd82c90635e16ad60c167a76b not found: ID does not exist"
Nov 03 17:24:08.392013 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.391959    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv" podStartSLOduration=1.336417428 podStartE2EDuration="4.391944256s" totalImagesPullingTime="3.055526828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:24:08.390788733 +0000 UTC m=+448.592126808" watchObservedRunningTime="2026-11-03 17:24:08.391944256 +0000 UTC m=+448.593282308"
Nov 03 17:24:08.509692 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.509661    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-cwq6g"]
Nov 03 17:24:08.511506 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.511474    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-cwq6g"]
Nov 03 17:24:08.626138 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.626061    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-tqmq6"]
Nov 03 17:24:08.630015 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:08.629990    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-tqmq6"]
Nov 03 17:24:10.001508 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:10.001473    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="29854459-4fcb-4a1a-9894-78d7abdc45b9" path="/var/lib/kubelet/pods/29854459-4fcb-4a1a-9894-78d7abdc45b9/volumes"
Nov 03 17:24:10.002135 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:10.001962    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ed5b3bfd-9c7f-40ea-8839-1cda896614e0" path="/var/lib/kubelet/pods/ed5b3bfd-9c7f-40ea-8839-1cda896614e0/volumes"
Nov 03 17:24:14.283617 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:24:14.283584    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 17:24:37.045190 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:24:37.045148    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:25:07.045191 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:25:07.045103    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:25:37.045005 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:25:37.044967    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:25:50.146095 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.146061    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"]
Nov 03 17:25:50.146583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.146462    5021 cpu_manager.go:414] "containerMap: removing container" podUID="ed5b3bfd-9c7f-40ea-8839-1cda896614e0" containerName="authorino"
Nov 03 17:25:50.146583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.146476    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ed5b3bfd-9c7f-40ea-8839-1cda896614e0" containerName="authorino"
Nov 03 17:25:50.146583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.146493    5021 cpu_manager.go:414] "containerMap: removing container" podUID="29854459-4fcb-4a1a-9894-78d7abdc45b9" containerName="authorino"
Nov 03 17:25:50.146583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.146498    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29854459-4fcb-4a1a-9894-78d7abdc45b9" containerName="authorino"
Nov 03 17:25:50.146583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.146580    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="ed5b3bfd-9c7f-40ea-8839-1cda896614e0" containerName="authorino"
Nov 03 17:25:50.146740 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.146589    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="29854459-4fcb-4a1a-9894-78d7abdc45b9" containerName="authorino"
Nov 03 17:25:50.149757 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.149740    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.226738 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.226707    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Nov 03 17:25:50.240783 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.240756    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Nov 03 17:25:50.260826 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.260799    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-chc7v\""
Nov 03 17:25:50.260826 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.260799    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Nov 03 17:25:50.281096 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.281067    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"]
Nov 03 17:25:50.333497 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.333467    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzl8t\" (UniqueName: \"kubernetes.io/projected/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-kube-api-access-xzl8t\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.333651 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.333500    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.333651 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.333630    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.333733 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.333687    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.333733 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.333705    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.333733 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.333727    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.435206 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.435112    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzl8t\" (UniqueName: \"kubernetes.io/projected/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-kube-api-access-xzl8t\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.435206 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.435152    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.435475 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.435282    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.435475 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.435354    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.435475 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.435372    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.435475 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.435396    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.435731 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.435698    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.435853 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.435705    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.435853 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.435760    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.437568 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.437548    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.437829 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.437812    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.498940 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.498910    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzl8t\" (UniqueName: \"kubernetes.io/projected/28b51572-e1b1-4c85-bd00-b3cf3ef2255a-kube-api-access-xzl8t\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg\" (UID: \"28b51572-e1b1-4c85-bd00-b3cf3ef2255a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:50.762898 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:50.762865    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:51.141322 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:51.141292    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"]
Nov 03 17:25:51.142814 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:25:51.142786    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b51572_e1b1_4c85_bd00_b3cf3ef2255a.slice/crio-233c232f8681aaebd1e7c2eb6b31015c10db9358b786ce1126f26a500b920d75 WatchSource:0}: Error finding container 233c232f8681aaebd1e7c2eb6b31015c10db9358b786ce1126f26a500b920d75: Status 404 returned error can't find the container with id 233c232f8681aaebd1e7c2eb6b31015c10db9358b786ce1126f26a500b920d75
Nov 03 17:25:51.785643 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:51.785609    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg" event={"ID":"28b51572-e1b1-4c85-bd00-b3cf3ef2255a","Type":"ContainerStarted","Data":"233c232f8681aaebd1e7c2eb6b31015c10db9358b786ce1126f26a500b920d75"}
Nov 03 17:25:53.797214 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:53.797160    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg" event={"ID":"28b51572-e1b1-4c85-bd00-b3cf3ef2255a","Type":"ContainerStarted","Data":"714d224050ea8c28fd19356cc4dc21cd84e75a653011f194dcfe731042ac1a23"}
Nov 03 17:25:53.920195 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:53.920136    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg" podStartSLOduration=1.655835611 podStartE2EDuration="3.920121888s" totalImagesPullingTime="2.264286277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:25:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:25:53.918746831 +0000 UTC m=+554.120084884" watchObservedRunningTime="2026-11-03 17:25:53.920121888 +0000 UTC m=+554.121459940"
Nov 03 17:25:54.763306 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:54.763272    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:25:55.798098 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.798060    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"]
Nov 03 17:25:55.801791 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.801772    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:55.856880 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.856849    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"]
Nov 03 17:25:55.881452 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.881412    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dcbc998-663a-49f1-a8e3-cb5515916207-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:55.881622 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.881458    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dcbc998-663a-49f1-a8e3-cb5515916207-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:55.881622 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.881554    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dcbc998-663a-49f1-a8e3-cb5515916207-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:55.881622 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.881591    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dcbc998-663a-49f1-a8e3-cb5515916207-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:55.881766 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.881739    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dcbc998-663a-49f1-a8e3-cb5515916207-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:55.881879 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.881855    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgwgc\" (UniqueName: \"kubernetes.io/projected/3dcbc998-663a-49f1-a8e3-cb5515916207-kube-api-access-sgwgc\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:55.906775 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.906751    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Nov 03 17:25:55.982847 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.982812    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dcbc998-663a-49f1-a8e3-cb5515916207-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:55.982847 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.982847    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgwgc\" (UniqueName: \"kubernetes.io/projected/3dcbc998-663a-49f1-a8e3-cb5515916207-kube-api-access-sgwgc\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:55.983118 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.982917    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dcbc998-663a-49f1-a8e3-cb5515916207-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:55.983118 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.982933    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dcbc998-663a-49f1-a8e3-cb5515916207-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:55.983118 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.982959    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dcbc998-663a-49f1-a8e3-cb5515916207-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:55.983118 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.982982    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dcbc998-663a-49f1-a8e3-cb5515916207-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:55.983424 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.983328    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dcbc998-663a-49f1-a8e3-cb5515916207-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:55.983424 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.983381    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dcbc998-663a-49f1-a8e3-cb5515916207-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:55.983507 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.983424    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dcbc998-663a-49f1-a8e3-cb5515916207-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:55.985281 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.985263    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dcbc998-663a-49f1-a8e3-cb5515916207-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:55.985562 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:55.985542    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dcbc998-663a-49f1-a8e3-cb5515916207-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:56.046330 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:56.046300    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgwgc\" (UniqueName: \"kubernetes.io/projected/3dcbc998-663a-49f1-a8e3-cb5515916207-kube-api-access-sgwgc\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-zj4jw\" (UID: \"3dcbc998-663a-49f1-a8e3-cb5515916207\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:56.115753 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:56.115663    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:56.492803 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:56.492772    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"]
Nov 03 17:25:56.494440 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:25:56.494414    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dcbc998_663a_49f1_a8e3_cb5515916207.slice/crio-3f8c020b9be47790efd6bbd05a56138511fd2d5098c97ec961a075a12c0af682 WatchSource:0}: Error finding container 3f8c020b9be47790efd6bbd05a56138511fd2d5098c97ec961a075a12c0af682: Status 404 returned error can't find the container with id 3f8c020b9be47790efd6bbd05a56138511fd2d5098c97ec961a075a12c0af682
Nov 03 17:25:56.813161 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:56.813123    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw" event={"ID":"3dcbc998-663a-49f1-a8e3-cb5515916207","Type":"ContainerStarted","Data":"3f8c020b9be47790efd6bbd05a56138511fd2d5098c97ec961a075a12c0af682"}
Nov 03 17:25:57.820289 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:57.820252    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw" event={"ID":"3dcbc998-663a-49f1-a8e3-cb5515916207","Type":"ContainerStarted","Data":"3b8ca386b4dae93caa61180b8799232546ca86c092a77094a0d8861a4a9ca317"}
Nov 03 17:25:57.944544 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:57.944417    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw" podStartSLOduration=2.327839005 podStartE2EDuration="2.944402879s" totalImagesPullingTime="616.563874ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:25:57.942187884 +0000 UTC m=+558.143525947" watchObservedRunningTime="2026-11-03 17:25:57.944402879 +0000 UTC m=+558.145740931"
Nov 03 17:25:58.115896 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:58.115812    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:25:59.274248 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.269855    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"]
Nov 03 17:25:59.282092 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.282053    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.314721 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.314682    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23ad22c7-395e-4be2-8b50-d594809fbfb5-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.314721 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.314725    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23ad22c7-395e-4be2-8b50-d594809fbfb5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.314951 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.314859    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23ad22c7-395e-4be2-8b50-d594809fbfb5-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.314951 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.314889    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23ad22c7-395e-4be2-8b50-d594809fbfb5-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.314951 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.314914    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzhhz\" (UniqueName: \"kubernetes.io/projected/23ad22c7-395e-4be2-8b50-d594809fbfb5-kube-api-access-kzhhz\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.314951 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.314940    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23ad22c7-395e-4be2-8b50-d594809fbfb5-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.328751 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.328718    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"]
Nov 03 17:25:59.376475 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.376445    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Nov 03 17:25:59.415920 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.415876    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23ad22c7-395e-4be2-8b50-d594809fbfb5-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.416114 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.415928    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23ad22c7-395e-4be2-8b50-d594809fbfb5-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.416114 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.415948    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23ad22c7-395e-4be2-8b50-d594809fbfb5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.416114 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.416033    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23ad22c7-395e-4be2-8b50-d594809fbfb5-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.416114 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.416061    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23ad22c7-395e-4be2-8b50-d594809fbfb5-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.416114 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.416096    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzhhz\" (UniqueName: \"kubernetes.io/projected/23ad22c7-395e-4be2-8b50-d594809fbfb5-kube-api-access-kzhhz\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.416502 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.416473    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23ad22c7-395e-4be2-8b50-d594809fbfb5-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.416565 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.416484    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23ad22c7-395e-4be2-8b50-d594809fbfb5-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.416778 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.416756    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23ad22c7-395e-4be2-8b50-d594809fbfb5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.418239 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.418202    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23ad22c7-395e-4be2-8b50-d594809fbfb5-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.418436 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.418420    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23ad22c7-395e-4be2-8b50-d594809fbfb5-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.479443 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.479407    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzhhz\" (UniqueName: \"kubernetes.io/projected/23ad22c7-395e-4be2-8b50-d594809fbfb5-kube-api-access-kzhhz\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-w5kj5\" (UID: \"23ad22c7-395e-4be2-8b50-d594809fbfb5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.604797 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.604713    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:25:59.981758 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:25:59.981731    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"]
Nov 03 17:25:59.982791 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:25:59.982760    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ad22c7_395e_4be2_8b50_d594809fbfb5.slice/crio-f1cc58064772a1a35b42b981829eed743ad254ddd3957c9468f8e67e3706aea5 WatchSource:0}: Error finding container f1cc58064772a1a35b42b981829eed743ad254ddd3957c9468f8e67e3706aea5: Status 404 returned error can't find the container with id f1cc58064772a1a35b42b981829eed743ad254ddd3957c9468f8e67e3706aea5
Nov 03 17:26:00.763075 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:00.763039    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:26:00.775546 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:00.775521    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:26:00.837591 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:00.837505    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5" event={"ID":"23ad22c7-395e-4be2-8b50-d594809fbfb5","Type":"ContainerStarted","Data":"30b44a9865d05fbff9a61e925ef6ae8e4ef0bacc9cc501e271553d5823713d26"}
Nov 03 17:26:00.837591 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:00.837562    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5" event={"ID":"23ad22c7-395e-4be2-8b50-d594809fbfb5","Type":"ContainerStarted","Data":"f1cc58064772a1a35b42b981829eed743ad254ddd3957c9468f8e67e3706aea5"}
Nov 03 17:26:00.849648 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:00.849622    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg"
Nov 03 17:26:01.142562 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:01.142459    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5" podStartSLOduration=1.548943329 podStartE2EDuration="2.142442772s" totalImagesPullingTime="593.499443ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:26:01.140078039 +0000 UTC m=+561.341416091" watchObservedRunningTime="2026-11-03 17:26:01.142442772 +0000 UTC m=+561.343780824"
Nov 03 17:26:01.605536 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:01.605487    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:26:06.121255 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:06.120483    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:26:06.146567 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:06.146538    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:26:06.881791 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:06.881762    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-zj4jw"
Nov 03 17:26:07.046400 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:26:07.046363    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:26:09.605800 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:09.605758    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:26:09.618009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:09.617982    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:26:09.896832 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:09.896743    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-w5kj5"
Nov 03 17:26:13.786178 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.786138    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"]
Nov 03 17:26:13.792992 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.792973    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:13.846739 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.846704    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"]
Nov 03 17:26:13.863719 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.863681    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbbe389f-0834-40b5-8681-06f9c206986c-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:13.863897 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.863740    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbbe389f-0834-40b5-8681-06f9c206986c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:13.863897 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.863832    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbbe389f-0834-40b5-8681-06f9c206986c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:13.863897 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.863885    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbbe389f-0834-40b5-8681-06f9c206986c-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:13.864077 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.863985    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbbe389f-0834-40b5-8681-06f9c206986c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:13.864077 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.864033    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8dbd\" (UniqueName: \"kubernetes.io/projected/cbbe389f-0834-40b5-8681-06f9c206986c-kube-api-access-r8dbd\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:13.895909 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.895869    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Nov 03 17:26:13.965208 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.965178    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbbe389f-0834-40b5-8681-06f9c206986c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:13.965208 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.965210    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8dbd\" (UniqueName: \"kubernetes.io/projected/cbbe389f-0834-40b5-8681-06f9c206986c-kube-api-access-r8dbd\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:13.965487 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.965351    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbbe389f-0834-40b5-8681-06f9c206986c-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:13.965487 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.965433    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbbe389f-0834-40b5-8681-06f9c206986c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:13.965487 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.965475    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbbe389f-0834-40b5-8681-06f9c206986c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:13.965649 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.965524    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbbe389f-0834-40b5-8681-06f9c206986c-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:13.965871 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.965848    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbbe389f-0834-40b5-8681-06f9c206986c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:13.965926 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.965852    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbbe389f-0834-40b5-8681-06f9c206986c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:13.966051 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.966031    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbbe389f-0834-40b5-8681-06f9c206986c-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:13.967586 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.967561    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbbe389f-0834-40b5-8681-06f9c206986c-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:13.967752 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:13.967734    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbbe389f-0834-40b5-8681-06f9c206986c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:14.029364 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:14.029331    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8dbd\" (UniqueName: \"kubernetes.io/projected/cbbe389f-0834-40b5-8681-06f9c206986c-kube-api-access-r8dbd\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk\" (UID: \"cbbe389f-0834-40b5-8681-06f9c206986c\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:14.106876 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:14.106802    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:14.486620 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:14.486595    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"]
Nov 03 17:26:14.487680 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:26:14.487643    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbbe389f_0834_40b5_8681_06f9c206986c.slice/crio-bb04642b933f1e2f6f5f4b44886a3f53e471b3fda468a5b9719ade5c50746313 WatchSource:0}: Error finding container bb04642b933f1e2f6f5f4b44886a3f53e471b3fda468a5b9719ade5c50746313: Status 404 returned error can't find the container with id bb04642b933f1e2f6f5f4b44886a3f53e471b3fda468a5b9719ade5c50746313
Nov 03 17:26:14.912474 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:14.912437    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk" event={"ID":"cbbe389f-0834-40b5-8681-06f9c206986c","Type":"ContainerStarted","Data":"bb04642b933f1e2f6f5f4b44886a3f53e471b3fda468a5b9719ade5c50746313"}
Nov 03 17:26:15.919093 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:15.919054    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk" event={"ID":"cbbe389f-0834-40b5-8681-06f9c206986c","Type":"ContainerStarted","Data":"637b108a26595ad841ade170eab4c511987e2848df6c7e04266c447a2ce8122f"}
Nov 03 17:26:16.045189 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:16.045117    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk" podStartSLOduration=2.3788044 podStartE2EDuration="3.045104061s" totalImagesPullingTime="666.299661ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:26:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:26:16.043764555 +0000 UTC m=+576.245102608" watchObservedRunningTime="2026-11-03 17:26:16.045104061 +0000 UTC m=+576.246442113"
Nov 03 17:26:16.107523 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:16.107476    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:24.108197 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:24.108086    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:24.120963 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:24.120937    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:24.975435 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:24.975401    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk"
Nov 03 17:26:28.365694 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.365659    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"]
Nov 03 17:26:28.369438 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.369419    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.426331 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.426298    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 03 17:26:28.477468 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.477433    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-t4h2g\""
Nov 03 17:26:28.480204 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.480179    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"]
Nov 03 17:26:28.505051 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.505013    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.505216 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.505087    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.505216 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.505192    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.505368 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.505285    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.505423 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.505371    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.505469 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.505426    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.505469 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.505448    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.505556 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.505542    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbl76\" (UniqueName: \"kubernetes.io/projected/480f6089-e4b0-41a1-be62-83d1d44f0eb4-kube-api-access-kbl76\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.505713 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.505692    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.606561 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.606525    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbl76\" (UniqueName: \"kubernetes.io/projected/480f6089-e4b0-41a1-be62-83d1d44f0eb4-kube-api-access-kbl76\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.606741 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.606572    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.606741 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.606604    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.606863 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.606737    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.606863 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.606804    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.606863 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.606846    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.607025 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.606877    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.607025 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.606915    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.607025 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.606942    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.607209 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.607183    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.607306 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.607208    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.607306 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.607291    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.607474 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.607449    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.607474 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.607464    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.609315 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.609297    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.609917 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.609895    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.669965 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.669894    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbl76\" (UniqueName: \"kubernetes.io/projected/480f6089-e4b0-41a1-be62-83d1d44f0eb4-kube-api-access-kbl76\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.670207 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.670184    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-krxb6\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:28.682103 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:28.682081    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:29.109644 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:29.109615    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"]
Nov 03 17:26:29.111251 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:26:29.111207    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod480f6089_e4b0_41a1_be62_83d1d44f0eb4.slice/crio-c339363bc6286373d75fa3eecfa35dafdef0d6f3f5c572b0da797766384e3093 WatchSource:0}: Error finding container c339363bc6286373d75fa3eecfa35dafdef0d6f3f5c572b0da797766384e3093: Status 404 returned error can't find the container with id c339363bc6286373d75fa3eecfa35dafdef0d6f3f5c572b0da797766384e3093
Nov 03 17:26:30.002526 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:30.002488    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6" event={"ID":"480f6089-e4b0-41a1-be62-83d1d44f0eb4","Type":"ContainerStarted","Data":"c339363bc6286373d75fa3eecfa35dafdef0d6f3f5c572b0da797766384e3093"}
Nov 03 17:26:33.136091 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:33.136059    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:26:33.136340 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:33.136137    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:26:33.136340 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:33.136167    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:26:34.020351 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:34.020317    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6" event={"ID":"480f6089-e4b0-41a1-be62-83d1d44f0eb4","Type":"ContainerStarted","Data":"85602ed0d85c9c4d7edd8c44b49f6b8af3175a7264aaee353b0ecebf96d31e7b"}
Nov 03 17:26:34.182517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:34.182465    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6" podStartSLOduration=2.160493164 podStartE2EDuration="6.182452101s" totalImagesPullingTime="4.021958937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:26:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:26:34.182215598 +0000 UTC m=+594.383553652" watchObservedRunningTime="2026-11-03 17:26:34.182452101 +0000 UTC m=+594.383790206"
Nov 03 17:26:34.682813 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:34.682773    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:34.684074 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:34.684046    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-krxb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Nov 03 17:26:34.684159 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:34.684112    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6" podUID="480f6089-e4b0-41a1-be62-83d1d44f0eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Nov 03 17:26:35.683461 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:35.683423    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-krxb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Nov 03 17:26:35.683833 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:35.683483    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6" podUID="480f6089-e4b0-41a1-be62-83d1d44f0eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Nov 03 17:26:36.682652 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:36.682613    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-krxb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Nov 03 17:26:36.682887 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:36.682672    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6" podUID="480f6089-e4b0-41a1-be62-83d1d44f0eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Nov 03 17:26:37.068353 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:26:37.068318    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:26:37.683454 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:37.683418    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-krxb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Nov 03 17:26:37.683637 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:37.683482    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6" podUID="480f6089-e4b0-41a1-be62-83d1d44f0eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Nov 03 17:26:38.682757 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:38.682716    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-krxb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Nov 03 17:26:38.683308 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:38.682776    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6" podUID="480f6089-e4b0-41a1-be62-83d1d44f0eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Nov 03 17:26:39.683114 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:39.683074    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-krxb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Nov 03 17:26:39.683529 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:39.683138    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6" podUID="480f6089-e4b0-41a1-be62-83d1d44f0eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Nov 03 17:26:40.051532 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:40.051501    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:26:40.051976 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:40.051955    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:26:40.683355 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:40.683317    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-krxb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Nov 03 17:26:40.683744 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:40.683378    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6" podUID="480f6089-e4b0-41a1-be62-83d1d44f0eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Nov 03 17:26:42.363507 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:42.363475    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:42.363959 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:42.363934    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:42.364746 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:42.364724    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:26:43.504980 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.504941    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"]
Nov 03 17:26:43.512606 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.512569    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.549123 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.549091    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.549123 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.549123    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.549342 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.549267    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.549342 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.549304    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.549342 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.549334    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgbbh\" (UniqueName: \"kubernetes.io/projected/06db63cd-7185-4e45-9930-8e1b6a018d32-kube-api-access-mgbbh\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.549454 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.549435    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06db63cd-7185-4e45-9930-8e1b6a018d32-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.549487 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.549473    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.549522 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.549507    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.549598 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.549576    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.634501 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.634465    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"]
Nov 03 17:26:43.650455 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.650424    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.650611 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.650488    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.650611 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.650524    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.650611 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.650563    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.650611 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.650587    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.650901 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.650867    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.651031 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.650905    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.651102 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.651044    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.651102 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.650934    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.651102 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.650949    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.651214 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.651100    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgbbh\" (UniqueName: \"kubernetes.io/projected/06db63cd-7185-4e45-9930-8e1b6a018d32-kube-api-access-mgbbh\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.651214 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.651110    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.651214 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.651171    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06db63cd-7185-4e45-9930-8e1b6a018d32-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.651937 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.651912    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06db63cd-7185-4e45-9930-8e1b6a018d32-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.653103 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.653076    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.653310 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.653288    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.714418 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.714385    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.714643 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.714619    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgbbh\" (UniqueName: \"kubernetes.io/projected/06db63cd-7185-4e45-9930-8e1b6a018d32-kube-api-access-mgbbh\") pod \"maas-default-gateway-openshift-default-58c6585447-nnt45\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:43.825728 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:43.825642    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:44.256014 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:44.255983    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"]
Nov 03 17:26:44.256852 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:26:44.256821    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06db63cd_7185_4e45_9930_8e1b6a018d32.slice/crio-613a159d1aed67b365ac89c0ebbfd25b538187c59c8aea6ec1e818160d4c8a56 WatchSource:0}: Error finding container 613a159d1aed67b365ac89c0ebbfd25b538187c59c8aea6ec1e818160d4c8a56: Status 404 returned error can't find the container with id 613a159d1aed67b365ac89c0ebbfd25b538187c59c8aea6ec1e818160d4c8a56
Nov 03 17:26:44.259019 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:44.258979    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:26:44.259132 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:44.259057    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:26:44.259132 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:44.259102    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:26:45.102518 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:45.102482    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45" event={"ID":"06db63cd-7185-4e45-9930-8e1b6a018d32","Type":"ContainerStarted","Data":"6f0681fc28363d52057aa9cc8922aae0b0bc733b9ba669ff1c064869abffd9f9"}
Nov 03 17:26:45.102955 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:45.102535    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45" event={"ID":"06db63cd-7185-4e45-9930-8e1b6a018d32","Type":"ContainerStarted","Data":"613a159d1aed67b365ac89c0ebbfd25b538187c59c8aea6ec1e818160d4c8a56"}
Nov 03 17:26:45.277457 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:45.277406    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45" podStartSLOduration=2.277391853 podStartE2EDuration="2.277391853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:26:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:26:45.276757837 +0000 UTC m=+605.478095892" watchObservedRunningTime="2026-11-03 17:26:45.277391853 +0000 UTC m=+605.478729906"
Nov 03 17:26:45.832589 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:45.832554    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:45.849387 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:45.849347    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-nnt45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Nov 03 17:26:45.849564 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:45.849406    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45" podUID="06db63cd-7185-4e45-9930-8e1b6a018d32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Nov 03 17:26:46.836685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:46.836646    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-nnt45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Nov 03 17:26:46.837317 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:46.837282    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45" podUID="06db63cd-7185-4e45-9930-8e1b6a018d32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Nov 03 17:26:47.849362 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:47.849325    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-nnt45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Nov 03 17:26:47.849767 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:47.849381    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45" podUID="06db63cd-7185-4e45-9930-8e1b6a018d32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Nov 03 17:26:48.047251 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:48.046080    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c4996b4f-m8ksh"]
Nov 03 17:26:48.053791 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:48.053767    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c4996b4f-m8ksh"
Nov 03 17:26:48.094506 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:48.094480    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c4996b4f-m8ksh"]
Nov 03 17:26:48.095348 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:48.095320    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f57c4b3-a9e2-4e43-ac33-3f75957f0668-tls-cert\") pod \"authorino-56c4996b4f-m8ksh\" (UID: \"9f57c4b3-a9e2-4e43-ac33-3f75957f0668\") " pod="kuadrant-system/authorino-56c4996b4f-m8ksh"
Nov 03 17:26:48.095528 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:48.095512    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc2k4\" (UniqueName: \"kubernetes.io/projected/9f57c4b3-a9e2-4e43-ac33-3f75957f0668-kube-api-access-cc2k4\") pod \"authorino-56c4996b4f-m8ksh\" (UID: \"9f57c4b3-a9e2-4e43-ac33-3f75957f0668\") " pod="kuadrant-system/authorino-56c4996b4f-m8ksh"
Nov 03 17:26:48.196706 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:48.196598    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2k4\" (UniqueName: \"kubernetes.io/projected/9f57c4b3-a9e2-4e43-ac33-3f75957f0668-kube-api-access-cc2k4\") pod \"authorino-56c4996b4f-m8ksh\" (UID: \"9f57c4b3-a9e2-4e43-ac33-3f75957f0668\") " pod="kuadrant-system/authorino-56c4996b4f-m8ksh"
Nov 03 17:26:48.196706 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:48.196659    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f57c4b3-a9e2-4e43-ac33-3f75957f0668-tls-cert\") pod \"authorino-56c4996b4f-m8ksh\" (UID: \"9f57c4b3-a9e2-4e43-ac33-3f75957f0668\") " pod="kuadrant-system/authorino-56c4996b4f-m8ksh"
Nov 03 17:26:48.199166 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:48.199139    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f57c4b3-a9e2-4e43-ac33-3f75957f0668-tls-cert\") pod \"authorino-56c4996b4f-m8ksh\" (UID: \"9f57c4b3-a9e2-4e43-ac33-3f75957f0668\") " pod="kuadrant-system/authorino-56c4996b4f-m8ksh"
Nov 03 17:26:48.260677 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:48.260647    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc2k4\" (UniqueName: \"kubernetes.io/projected/9f57c4b3-a9e2-4e43-ac33-3f75957f0668-kube-api-access-cc2k4\") pod \"authorino-56c4996b4f-m8ksh\" (UID: \"9f57c4b3-a9e2-4e43-ac33-3f75957f0668\") " pod="kuadrant-system/authorino-56c4996b4f-m8ksh"
Nov 03 17:26:48.366778 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:48.366742    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c4996b4f-m8ksh"
Nov 03 17:26:48.754849 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:48.754823    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c4996b4f-m8ksh"]
Nov 03 17:26:48.756723 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:26:48.756692    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f57c4b3_a9e2_4e43_ac33_3f75957f0668.slice/crio-d23ca7fd9c1224ecf361458697695da8bbe28ca19c32ea26bb78836032087a31 WatchSource:0}: Error finding container d23ca7fd9c1224ecf361458697695da8bbe28ca19c32ea26bb78836032087a31: Status 404 returned error can't find the container with id d23ca7fd9c1224ecf361458697695da8bbe28ca19c32ea26bb78836032087a31
Nov 03 17:26:48.845249 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:48.832591    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-nnt45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Nov 03 17:26:48.845249 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:48.832657    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45" podUID="06db63cd-7185-4e45-9930-8e1b6a018d32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Nov 03 17:26:49.146307 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:49.131974    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c4996b4f-m8ksh" event={"ID":"9f57c4b3-a9e2-4e43-ac33-3f75957f0668","Type":"ContainerStarted","Data":"d23ca7fd9c1224ecf361458697695da8bbe28ca19c32ea26bb78836032087a31"}
Nov 03 17:26:49.847251 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:49.846657    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-nnt45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Nov 03 17:26:49.847251 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:49.846730    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45" podUID="06db63cd-7185-4e45-9930-8e1b6a018d32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Nov 03 17:26:50.826878 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:50.826842    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-nnt45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Nov 03 17:26:50.827314 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:50.826904    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45" podUID="06db63cd-7185-4e45-9930-8e1b6a018d32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Nov 03 17:26:51.149593 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:51.149555    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c4996b4f-m8ksh" event={"ID":"9f57c4b3-a9e2-4e43-ac33-3f75957f0668","Type":"ContainerStarted","Data":"66e3a5fd065883fa79b552d8c1bdb4331318edca7b818c4bdd4d3ae6b3b38f9e"}
Nov 03 17:26:51.275989 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:51.275932    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c4996b4f-m8ksh" podStartSLOduration=2.414631005 podStartE2EDuration="4.275918662s" totalImagesPullingTime="1.861287657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:26:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:26:51.274547014 +0000 UTC m=+611.475885067" watchObservedRunningTime="2026-11-03 17:26:51.275918662 +0000 UTC m=+611.477256767"
Nov 03 17:26:51.306720 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:51.306678    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c6844cdb-jwlb4"]
Nov 03 17:26:51.306951 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:51.306919    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6c6844cdb-jwlb4" podUID="65b3b20a-a761-435a-994d-281db488621a" containerName="authorino" containerID="cri-o://0f0619d66cbea205150be110cd7b81bc7fe6b0c865daf287d2da849ecf7412bf" gracePeriod=30
Nov 03 17:26:51.584002 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:51.583970    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c6844cdb-jwlb4"
Nov 03 17:26:51.632514 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:51.632475    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65b3b20a-a761-435a-994d-281db488621a-kube-api-access-d2nlx\" (UniqueName: \"kubernetes.io/projected/65b3b20a-a761-435a-994d-281db488621a-kube-api-access-d2nlx\") pod \"65b3b20a-a761-435a-994d-281db488621a\" (UID: \"65b3b20a-a761-435a-994d-281db488621a\") "
Nov 03 17:26:51.632693 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:51.632604    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/65b3b20a-a761-435a-994d-281db488621a-tls-cert\" (UniqueName: \"kubernetes.io/secret/65b3b20a-a761-435a-994d-281db488621a-tls-cert\") pod \"65b3b20a-a761-435a-994d-281db488621a\" (UID: \"65b3b20a-a761-435a-994d-281db488621a\") "
Nov 03 17:26:51.634721 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:51.634675    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65b3b20a-a761-435a-994d-281db488621a-kube-api-access-d2nlx" pod "65b3b20a-a761-435a-994d-281db488621a" (UID: "65b3b20a-a761-435a-994d-281db488621a"). InnerVolumeSpecName "kube-api-access-d2nlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:26:51.649729 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:51.649165    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65b3b20a-a761-435a-994d-281db488621a-tls-cert" pod "65b3b20a-a761-435a-994d-281db488621a" (UID: "65b3b20a-a761-435a-994d-281db488621a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:26:51.734190 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:51.734095    5021 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65b3b20a-a761-435a-994d-281db488621a-tls-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:26:51.734190 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:51.734126    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2nlx\" (UniqueName: \"kubernetes.io/projected/65b3b20a-a761-435a-994d-281db488621a-kube-api-access-d2nlx\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:26:51.826729 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:51.826681    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-nnt45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Nov 03 17:26:51.826924 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:51.826747    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45" podUID="06db63cd-7185-4e45-9930-8e1b6a018d32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Nov 03 17:26:52.157885 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:52.157844    5021 generic.go:356] "Generic (PLEG): container finished" podID="65b3b20a-a761-435a-994d-281db488621a" containerID="0f0619d66cbea205150be110cd7b81bc7fe6b0c865daf287d2da849ecf7412bf" exitCode=0
Nov 03 17:26:52.157885 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:52.157881    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c6844cdb-jwlb4"
Nov 03 17:26:52.158103 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:52.157932    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c6844cdb-jwlb4" event={"ID":"65b3b20a-a761-435a-994d-281db488621a","Type":"ContainerDied","Data":"0f0619d66cbea205150be110cd7b81bc7fe6b0c865daf287d2da849ecf7412bf"}
Nov 03 17:26:52.158103 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:52.157983    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c6844cdb-jwlb4" event={"ID":"65b3b20a-a761-435a-994d-281db488621a","Type":"ContainerDied","Data":"1cc1530b20d6bc72e49adf6acae61f9fb8c48fe02b200e368707ae580c35ac88"}
Nov 03 17:26:52.158103 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:52.158007    5021 scope.go:122] "RemoveContainer" containerID="0f0619d66cbea205150be110cd7b81bc7fe6b0c865daf287d2da849ecf7412bf"
Nov 03 17:26:52.167706 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:52.167686    5021 scope.go:122] "RemoveContainer" containerID="0f0619d66cbea205150be110cd7b81bc7fe6b0c865daf287d2da849ecf7412bf"
Nov 03 17:26:52.168004 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:26:52.167985    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f0619d66cbea205150be110cd7b81bc7fe6b0c865daf287d2da849ecf7412bf\": container with ID starting with 0f0619d66cbea205150be110cd7b81bc7fe6b0c865daf287d2da849ecf7412bf not found: ID does not exist" containerID="0f0619d66cbea205150be110cd7b81bc7fe6b0c865daf287d2da849ecf7412bf"
Nov 03 17:26:52.168081 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:52.168016    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0619d66cbea205150be110cd7b81bc7fe6b0c865daf287d2da849ecf7412bf"} err="failed to get container status \"0f0619d66cbea205150be110cd7b81bc7fe6b0c865daf287d2da849ecf7412bf\": rpc error: code = NotFound desc = could not find container \"0f0619d66cbea205150be110cd7b81bc7fe6b0c865daf287d2da849ecf7412bf\": container with ID starting with 0f0619d66cbea205150be110cd7b81bc7fe6b0c865daf287d2da849ecf7412bf not found: ID does not exist"
Nov 03 17:26:52.330587 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:52.330495    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c6844cdb-jwlb4"]
Nov 03 17:26:52.339118 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:52.339086    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c6844cdb-jwlb4"]
Nov 03 17:26:53.715773 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:53.715730    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:53.716642 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:53.716612    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:53.717569 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:53.717552    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:26:54.003363 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:26:54.003334    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="65b3b20a-a761-435a-994d-281db488621a" path="/var/lib/kubelet/pods/65b3b20a-a761-435a-994d-281db488621a/volumes"
Nov 03 17:27:07.045871 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:27:07.045834    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:27:31.028321 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.028281    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"]
Nov 03 17:27:31.028793 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.028698    5021 cpu_manager.go:414] "containerMap: removing container" podUID="65b3b20a-a761-435a-994d-281db488621a" containerName="authorino"
Nov 03 17:27:31.028793 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.028709    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="65b3b20a-a761-435a-994d-281db488621a" containerName="authorino"
Nov 03 17:27:31.028896 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.028801    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="65b3b20a-a761-435a-994d-281db488621a" containerName="authorino"
Nov 03 17:27:31.032135 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.032112    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"
Nov 03 17:27:31.087824 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.087777    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"]
Nov 03 17:27:31.136656 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.136621    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-2355f4-dockercfg-8zvqp\""
Nov 03 17:27:31.136656 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.136625    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-2355f4\""
Nov 03 17:27:31.142099 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.142075    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fee614b-4abf-47b2-9426-4938635fdf21-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv\" (UID: \"9fee614b-4abf-47b2-9426-4938635fdf21\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"
Nov 03 17:27:31.142197 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.142125    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcpwl\" (UniqueName: \"kubernetes.io/projected/9fee614b-4abf-47b2-9426-4938635fdf21-kube-api-access-dcpwl\") pod \"payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv\" (UID: \"9fee614b-4abf-47b2-9426-4938635fdf21\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"
Nov 03 17:27:31.187873 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.187835    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"]
Nov 03 17:27:31.191861 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.191826    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"
Nov 03 17:27:31.242996 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.242958    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94zdw\" (UniqueName: \"kubernetes.io/projected/af74c940-4933-4b51-8d80-6245266f7eb2-kube-api-access-94zdw\") pod \"payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn\" (UID: \"af74c940-4933-4b51-8d80-6245266f7eb2\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"
Nov 03 17:27:31.243151 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.243047    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af74c940-4933-4b51-8d80-6245266f7eb2-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn\" (UID: \"af74c940-4933-4b51-8d80-6245266f7eb2\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"
Nov 03 17:27:31.243201 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.243147    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fee614b-4abf-47b2-9426-4938635fdf21-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv\" (UID: \"9fee614b-4abf-47b2-9426-4938635fdf21\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"
Nov 03 17:27:31.243262 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.243242    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcpwl\" (UniqueName: \"kubernetes.io/projected/9fee614b-4abf-47b2-9426-4938635fdf21-kube-api-access-dcpwl\") pod \"payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv\" (UID: \"9fee614b-4abf-47b2-9426-4938635fdf21\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"
Nov 03 17:27:31.244095 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.244063    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fee614b-4abf-47b2-9426-4938635fdf21-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv\" (UID: \"9fee614b-4abf-47b2-9426-4938635fdf21\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"
Nov 03 17:27:31.247521 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.247493    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"]
Nov 03 17:27:31.307311 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.307222    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcpwl\" (UniqueName: \"kubernetes.io/projected/9fee614b-4abf-47b2-9426-4938635fdf21-kube-api-access-dcpwl\") pod \"payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv\" (UID: \"9fee614b-4abf-47b2-9426-4938635fdf21\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"
Nov 03 17:27:31.344379 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.344346    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af74c940-4933-4b51-8d80-6245266f7eb2-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn\" (UID: \"af74c940-4933-4b51-8d80-6245266f7eb2\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"
Nov 03 17:27:31.344523 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.344442    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94zdw\" (UniqueName: \"kubernetes.io/projected/af74c940-4933-4b51-8d80-6245266f7eb2-kube-api-access-94zdw\") pod \"payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn\" (UID: \"af74c940-4933-4b51-8d80-6245266f7eb2\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"
Nov 03 17:27:31.344783 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.344769    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"
Nov 03 17:27:31.345007 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.344987    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af74c940-4933-4b51-8d80-6245266f7eb2-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn\" (UID: \"af74c940-4933-4b51-8d80-6245266f7eb2\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"
Nov 03 17:27:31.407767 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.407736    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94zdw\" (UniqueName: \"kubernetes.io/projected/af74c940-4933-4b51-8d80-6245266f7eb2-kube-api-access-94zdw\") pod \"payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn\" (UID: \"af74c940-4933-4b51-8d80-6245266f7eb2\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"
Nov 03 17:27:31.505213 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.505179    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"
Nov 03 17:27:31.724544 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.724512    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"]
Nov 03 17:27:31.725263 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:27:31.725215    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fee614b_4abf_47b2_9426_4938635fdf21.slice/crio-7ce6ee7ddc0e7a02b28829b88e24d17316572086f12a283c7a2207798fcb7928 WatchSource:0}: Error finding container 7ce6ee7ddc0e7a02b28829b88e24d17316572086f12a283c7a2207798fcb7928: Status 404 returned error can't find the container with id 7ce6ee7ddc0e7a02b28829b88e24d17316572086f12a283c7a2207798fcb7928
Nov 03 17:27:31.727096 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.727077    5021 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 17:27:31.891895 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:31.891864    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"]
Nov 03 17:27:32.404343 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:32.404305    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn" event={"ID":"af74c940-4933-4b51-8d80-6245266f7eb2","Type":"ContainerStarted","Data":"a9927d90b666f99423bd81b9fe54fffa58ef83c9091fc4a10006749a0a505ab3"}
Nov 03 17:27:32.405942 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:32.405911    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv" event={"ID":"9fee614b-4abf-47b2-9426-4938635fdf21","Type":"ContainerStarted","Data":"7ce6ee7ddc0e7a02b28829b88e24d17316572086f12a283c7a2207798fcb7928"}
Nov 03 17:27:33.464589 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:33.464553    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"]
Nov 03 17:27:33.468991 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:33.468961    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:27:33.525657 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:33.525620    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"]
Nov 03 17:27:33.571058 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:33.571010    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl4wl\" (UniqueName: \"kubernetes.io/projected/2b724546-821d-4460-a332-272c8b04c729-kube-api-access-bl4wl\") pod \"maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5\" (UID: \"2b724546-821d-4460-a332-272c8b04c729\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:27:33.571310 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:33.571175    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b724546-821d-4460-a332-272c8b04c729-metrics-certs\") pod \"maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5\" (UID: \"2b724546-821d-4460-a332-272c8b04c729\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:27:33.571399 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:33.571338    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b724546-821d-4460-a332-272c8b04c729-maas-api-tls\") pod \"maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5\" (UID: \"2b724546-821d-4460-a332-272c8b04c729\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:27:33.571461 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:33.571399    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b724546-821d-4460-a332-272c8b04c729-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5\" (UID: \"2b724546-821d-4460-a332-272c8b04c729\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:27:33.577267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:33.575522    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-687fb3-serving-cert\""
Nov 03 17:27:33.672760 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:33.672719    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b724546-821d-4460-a332-272c8b04c729-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5\" (UID: \"2b724546-821d-4460-a332-272c8b04c729\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:27:33.672959 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:33.672771    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl4wl\" (UniqueName: \"kubernetes.io/projected/2b724546-821d-4460-a332-272c8b04c729-kube-api-access-bl4wl\") pod \"maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5\" (UID: \"2b724546-821d-4460-a332-272c8b04c729\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:27:33.672959 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:33.672870    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b724546-821d-4460-a332-272c8b04c729-metrics-certs\") pod \"maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5\" (UID: \"2b724546-821d-4460-a332-272c8b04c729\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:27:33.672959 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:33.672946    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b724546-821d-4460-a332-272c8b04c729-maas-api-tls\") pod \"maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5\" (UID: \"2b724546-821d-4460-a332-272c8b04c729\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:27:33.673141 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:27:33.673049    5021 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-serving-cert: secret "maas-api-e2e-worker-w0-687fb3-serving-cert" not found
Nov 03 17:27:33.673141 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:27:33.673121    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b724546-821d-4460-a332-272c8b04c729-maas-api-tls podName:2b724546-821d-4460-a332-272c8b04c729 nodeName:}" failed. No retries permitted until 2026-11-03 17:27:34.173101718 +0000 UTC m=+654.374439764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2b724546-821d-4460-a332-272c8b04c729-maas-api-tls") pod "maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5" (UID: "2b724546-821d-4460-a332-272c8b04c729") : secret "maas-api-e2e-worker-w0-687fb3-serving-cert" not found
Nov 03 17:27:33.673586 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:33.673561    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b724546-821d-4460-a332-272c8b04c729-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5\" (UID: \"2b724546-821d-4460-a332-272c8b04c729\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:27:33.676750 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:33.676722    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b724546-821d-4460-a332-272c8b04c729-metrics-certs\") pod \"maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5\" (UID: \"2b724546-821d-4460-a332-272c8b04c729\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:27:33.739635 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:33.739554    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl4wl\" (UniqueName: \"kubernetes.io/projected/2b724546-821d-4460-a332-272c8b04c729-kube-api-access-bl4wl\") pod \"maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5\" (UID: \"2b724546-821d-4460-a332-272c8b04c729\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:27:34.179538 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:34.179499    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b724546-821d-4460-a332-272c8b04c729-maas-api-tls\") pod \"maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5\" (UID: \"2b724546-821d-4460-a332-272c8b04c729\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:27:34.182477 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:34.182445    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b724546-821d-4460-a332-272c8b04c729-maas-api-tls\") pod \"maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5\" (UID: \"2b724546-821d-4460-a332-272c8b04c729\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:27:34.386505 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:34.386464    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:27:34.812672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:34.812588    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"]
Nov 03 17:27:34.816619 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:27:34.816573    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b724546_821d_4460_a332_272c8b04c729.slice/crio-d9647c44c81d48b98af99f70ad69307cac04bc6a32d23216ca7445d9c4c3511d WatchSource:0}: Error finding container d9647c44c81d48b98af99f70ad69307cac04bc6a32d23216ca7445d9c4c3511d: Status 404 returned error can't find the container with id d9647c44c81d48b98af99f70ad69307cac04bc6a32d23216ca7445d9c4c3511d
Nov 03 17:27:35.439722 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.439684    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5" event={"ID":"2b724546-821d-4460-a332-272c8b04c729","Type":"ContainerStarted","Data":"d9647c44c81d48b98af99f70ad69307cac04bc6a32d23216ca7445d9c4c3511d"}
Nov 03 17:27:35.441178 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.441145    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn" event={"ID":"af74c940-4933-4b51-8d80-6245266f7eb2","Type":"ContainerStarted","Data":"1b906deeb9582783e62c5f3270397c91df2adf9f03ba162076a0b36d2b6b261e"}
Nov 03 17:27:35.441324 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.441249    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"
Nov 03 17:27:35.442588 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.442564    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv" event={"ID":"9fee614b-4abf-47b2-9426-4938635fdf21","Type":"ContainerStarted","Data":"23ea4da175cb61aaa45e8261feeeb5726ac972115965090e074c30e1e1907da0"}
Nov 03 17:27:35.442694 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.442618    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"
Nov 03 17:27:35.562545 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.562489    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn" podStartSLOduration=1.501098732 podStartE2EDuration="4.562474189s" totalImagesPullingTime="3.061375457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:27:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:27:35.561112841 +0000 UTC m=+655.762450894" watchObservedRunningTime="2026-11-03 17:27:35.562474189 +0000 UTC m=+655.763812256"
Nov 03 17:27:35.614965 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.614930    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"]
Nov 03 17:27:35.618656 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.618636    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"
Nov 03 17:27:35.668995 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.668961    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"]
Nov 03 17:27:35.673113 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.673085    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-687fb3-dockercfg-46qll\""
Nov 03 17:27:35.673282 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.673122    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-687fb3\""
Nov 03 17:27:35.682750 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.682688    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv" podStartSLOduration=2.5195847689999997 podStartE2EDuration="5.682671431s" totalImagesPullingTime="3.163086662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:27:35.681520985 +0000 UTC m=+655.882859046" watchObservedRunningTime="2026-11-03 17:27:35.682671431 +0000 UTC m=+655.884009485"
Nov 03 17:27:35.696105 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.696012    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9817c092-c573-42b5-a7ad-84b4881f365d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2\" (UID: \"9817c092-c573-42b5-a7ad-84b4881f365d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"
Nov 03 17:27:35.696105 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.696080    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-984bv\" (UniqueName: \"kubernetes.io/projected/9817c092-c573-42b5-a7ad-84b4881f365d-kube-api-access-984bv\") pod \"payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2\" (UID: \"9817c092-c573-42b5-a7ad-84b4881f365d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"
Nov 03 17:27:35.740936 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.740910    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"]
Nov 03 17:27:35.744573 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.744556    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"
Nov 03 17:27:35.797058 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.797025    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvsbd\" (UniqueName: \"kubernetes.io/projected/946f62e8-f954-4cdf-b832-dcbe9962a294-kube-api-access-kvsbd\") pod \"payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p\" (UID: \"946f62e8-f954-4cdf-b832-dcbe9962a294\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"
Nov 03 17:27:35.797178 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.797080    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9817c092-c573-42b5-a7ad-84b4881f365d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2\" (UID: \"9817c092-c573-42b5-a7ad-84b4881f365d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"
Nov 03 17:27:35.797178 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.797153    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/946f62e8-f954-4cdf-b832-dcbe9962a294-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p\" (UID: \"946f62e8-f954-4cdf-b832-dcbe9962a294\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"
Nov 03 17:27:35.797324 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.797206    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-984bv\" (UniqueName: \"kubernetes.io/projected/9817c092-c573-42b5-a7ad-84b4881f365d-kube-api-access-984bv\") pod \"payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2\" (UID: \"9817c092-c573-42b5-a7ad-84b4881f365d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"
Nov 03 17:27:35.797770 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.797746    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9817c092-c573-42b5-a7ad-84b4881f365d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2\" (UID: \"9817c092-c573-42b5-a7ad-84b4881f365d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"
Nov 03 17:27:35.802358 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.802330    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"]
Nov 03 17:27:35.860077 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.860045    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-984bv\" (UniqueName: \"kubernetes.io/projected/9817c092-c573-42b5-a7ad-84b4881f365d-kube-api-access-984bv\") pod \"payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2\" (UID: \"9817c092-c573-42b5-a7ad-84b4881f365d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"
Nov 03 17:27:35.897725 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.897688    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/946f62e8-f954-4cdf-b832-dcbe9962a294-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p\" (UID: \"946f62e8-f954-4cdf-b832-dcbe9962a294\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"
Nov 03 17:27:35.897895 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.897859    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvsbd\" (UniqueName: \"kubernetes.io/projected/946f62e8-f954-4cdf-b832-dcbe9962a294-kube-api-access-kvsbd\") pod \"payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p\" (UID: \"946f62e8-f954-4cdf-b832-dcbe9962a294\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"
Nov 03 17:27:35.898401 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.898378    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/946f62e8-f954-4cdf-b832-dcbe9962a294-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p\" (UID: \"946f62e8-f954-4cdf-b832-dcbe9962a294\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"
Nov 03 17:27:35.932253 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.932218    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"
Nov 03 17:27:35.961970 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:35.961898    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvsbd\" (UniqueName: \"kubernetes.io/projected/946f62e8-f954-4cdf-b832-dcbe9962a294-kube-api-access-kvsbd\") pod \"payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p\" (UID: \"946f62e8-f954-4cdf-b832-dcbe9962a294\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"
Nov 03 17:27:36.058903 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:36.058873    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"
Nov 03 17:27:36.319710 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:36.319684    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"]
Nov 03 17:27:36.319820 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:27:36.319684    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9817c092_c573_42b5_a7ad_84b4881f365d.slice/crio-2ea35ec8e5a309fe498c08e7975eff42412d4b8f67e33ff14d261b0468a769e3 WatchSource:0}: Error finding container 2ea35ec8e5a309fe498c08e7975eff42412d4b8f67e33ff14d261b0468a769e3: Status 404 returned error can't find the container with id 2ea35ec8e5a309fe498c08e7975eff42412d4b8f67e33ff14d261b0468a769e3
Nov 03 17:27:36.436516 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:27:36.436488    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod946f62e8_f954_4cdf_b832_dcbe9962a294.slice/crio-a1ba3fd2bfbe251a5824f74cc00517b4063bb5f4eec4b01aa296324cff9e6858 WatchSource:0}: Error finding container a1ba3fd2bfbe251a5824f74cc00517b4063bb5f4eec4b01aa296324cff9e6858: Status 404 returned error can't find the container with id a1ba3fd2bfbe251a5824f74cc00517b4063bb5f4eec4b01aa296324cff9e6858
Nov 03 17:27:36.437769 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:36.437744    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"]
Nov 03 17:27:36.449400 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:36.449368    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2" event={"ID":"9817c092-c573-42b5-a7ad-84b4881f365d","Type":"ContainerStarted","Data":"68f8bde758924ad1bbd0688e13f33b941d31804983f9dd67737df4348d1f1111"}
Nov 03 17:27:36.449523 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:36.449431    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"
Nov 03 17:27:36.449523 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:36.449454    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2" event={"ID":"9817c092-c573-42b5-a7ad-84b4881f365d","Type":"ContainerStarted","Data":"2ea35ec8e5a309fe498c08e7975eff42412d4b8f67e33ff14d261b0468a769e3"}
Nov 03 17:27:36.450643 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:36.450617    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p" event={"ID":"946f62e8-f954-4cdf-b832-dcbe9962a294","Type":"ContainerStarted","Data":"a1ba3fd2bfbe251a5824f74cc00517b4063bb5f4eec4b01aa296324cff9e6858"}
Nov 03 17:27:36.452286 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:36.452260    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5" event={"ID":"2b724546-821d-4460-a332-272c8b04c729","Type":"ContainerStarted","Data":"3461d243bc902a59fd2e94b5173145065026d30179b804c96eb6a34d42270504"}
Nov 03 17:27:36.452455 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:36.452430    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:27:36.571791 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:36.571675    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2" podStartSLOduration=1.571658724 podStartE2EDuration="1.571658724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:27:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:27:36.569536886 +0000 UTC m=+656.770874949" watchObservedRunningTime="2026-11-03 17:27:36.571658724 +0000 UTC m=+656.772996778"
Nov 03 17:27:36.696640 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:36.696588    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5" podStartSLOduration=2.734083151 podStartE2EDuration="3.696574996s" totalImagesPullingTime="962.491845ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:27:36.69440232 +0000 UTC m=+656.895740372" watchObservedRunningTime="2026-11-03 17:27:36.696574996 +0000 UTC m=+656.897913048"
Nov 03 17:27:37.045073 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:27:37.045038    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:27:37.459755 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:37.459659    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p" event={"ID":"946f62e8-f954-4cdf-b832-dcbe9962a294","Type":"ContainerStarted","Data":"819289051bab245278d2f31a7f32eb42e8b0cd2b30e54c16498687ca20455f41"}
Nov 03 17:27:37.459980 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:37.459960    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"
Nov 03 17:27:37.580583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:37.580520    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p" podStartSLOduration=2.580504363 podStartE2EDuration="2.580504363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:27:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:27:37.578427707 +0000 UTC m=+657.779765759" watchObservedRunningTime="2026-11-03 17:27:37.580504363 +0000 UTC m=+657.781842414"
Nov 03 17:27:37.903186 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:37.903144    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"]
Nov 03 17:27:37.906769 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:37.906744    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"
Nov 03 17:27:37.961066 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:37.961034    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-praxis-a-8fc5ec\""
Nov 03 17:27:37.962361 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:37.962328    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"]
Nov 03 17:27:38.010313 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.010272    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-praxis-a-8fc5ec-dockercfg-rlp27\""
Nov 03 17:27:38.017893 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.017868    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp\" (UID: \"c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0\") " pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"
Nov 03 17:27:38.017983 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.017902    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqct4\" (UniqueName: \"kubernetes.io/projected/c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0-kube-api-access-hqct4\") pod \"payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp\" (UID: \"c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0\") " pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"
Nov 03 17:27:38.053813 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.053780    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"]
Nov 03 17:27:38.057623 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.057600    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"
Nov 03 17:27:38.113883 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.113850    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"]
Nov 03 17:27:38.119272 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.119242    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqct4\" (UniqueName: \"kubernetes.io/projected/c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0-kube-api-access-hqct4\") pod \"payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp\" (UID: \"c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0\") " pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"
Nov 03 17:27:38.119445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.119429    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae6b2e16-8755-4481-9b70-d66354dc00dc-plugins-config-volume\") pod \"payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9\" (UID: \"ae6b2e16-8755-4481-9b70-d66354dc00dc\") " pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"
Nov 03 17:27:38.119514 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.119463    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5rlv\" (UniqueName: \"kubernetes.io/projected/ae6b2e16-8755-4481-9b70-d66354dc00dc-kube-api-access-n5rlv\") pod \"payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9\" (UID: \"ae6b2e16-8755-4481-9b70-d66354dc00dc\") " pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"
Nov 03 17:27:38.119514 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.119488    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp\" (UID: \"c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0\") " pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"
Nov 03 17:27:38.121432 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.121408    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp\" (UID: \"c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0\") " pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"
Nov 03 17:27:38.196313 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.196242    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqct4\" (UniqueName: \"kubernetes.io/projected/c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0-kube-api-access-hqct4\") pod \"payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp\" (UID: \"c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0\") " pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"
Nov 03 17:27:38.220707 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.220679    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"
Nov 03 17:27:38.220990 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.220966    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae6b2e16-8755-4481-9b70-d66354dc00dc-plugins-config-volume\") pod \"payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9\" (UID: \"ae6b2e16-8755-4481-9b70-d66354dc00dc\") " pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"
Nov 03 17:27:38.221049 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.221005    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5rlv\" (UniqueName: \"kubernetes.io/projected/ae6b2e16-8755-4481-9b70-d66354dc00dc-kube-api-access-n5rlv\") pod \"payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9\" (UID: \"ae6b2e16-8755-4481-9b70-d66354dc00dc\") " pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"
Nov 03 17:27:38.221663 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.221645    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae6b2e16-8755-4481-9b70-d66354dc00dc-plugins-config-volume\") pod \"payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9\" (UID: \"ae6b2e16-8755-4481-9b70-d66354dc00dc\") " pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"
Nov 03 17:27:38.290068 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.290028    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5rlv\" (UniqueName: \"kubernetes.io/projected/ae6b2e16-8755-4481-9b70-d66354dc00dc-kube-api-access-n5rlv\") pod \"payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9\" (UID: \"ae6b2e16-8755-4481-9b70-d66354dc00dc\") " pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"
Nov 03 17:27:38.371756 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.371724    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"
Nov 03 17:27:38.598748 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.598721    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"]
Nov 03 17:27:38.600420 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:27:38.600393    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f631d5_ef04_4e49_ba0f_bb1e8c76f6c0.slice/crio-76e50b6701eddddb1c1b636e022b17cd2f59d1d85ea73bcea231c9b59b8bdb6f WatchSource:0}: Error finding container 76e50b6701eddddb1c1b636e022b17cd2f59d1d85ea73bcea231c9b59b8bdb6f: Status 404 returned error can't find the container with id 76e50b6701eddddb1c1b636e022b17cd2f59d1d85ea73bcea231c9b59b8bdb6f
Nov 03 17:27:38.751257 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:38.751216    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"]
Nov 03 17:27:38.751978 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:27:38.751948    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae6b2e16_8755_4481_9b70_d66354dc00dc.slice/crio-7b8414fb96cc76e84a3bace2edafdee66f21ad4d17a376689316d90d7a078d2f WatchSource:0}: Error finding container 7b8414fb96cc76e84a3bace2edafdee66f21ad4d17a376689316d90d7a078d2f: Status 404 returned error can't find the container with id 7b8414fb96cc76e84a3bace2edafdee66f21ad4d17a376689316d90d7a078d2f
Nov 03 17:27:39.474793 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:39.474756    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9" event={"ID":"ae6b2e16-8755-4481-9b70-d66354dc00dc","Type":"ContainerStarted","Data":"7462f51652b999b3ece221eb730eaedc1d62b015388e517b56bf9a1611a2205d"}
Nov 03 17:27:39.475265 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:39.474844    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9" event={"ID":"ae6b2e16-8755-4481-9b70-d66354dc00dc","Type":"ContainerStarted","Data":"7b8414fb96cc76e84a3bace2edafdee66f21ad4d17a376689316d90d7a078d2f"}
Nov 03 17:27:39.475265 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:39.474965    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"
Nov 03 17:27:39.476445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:39.476421    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp" event={"ID":"c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0","Type":"ContainerStarted","Data":"33d4c0f5156e19f523d9e3bbfa9cd616fedeecf5b07ff08373942388de61b879"}
Nov 03 17:27:39.476520 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:39.476466    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp" event={"ID":"c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0","Type":"ContainerStarted","Data":"76e50b6701eddddb1c1b636e022b17cd2f59d1d85ea73bcea231c9b59b8bdb6f"}
Nov 03 17:27:39.476520 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:39.476485    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"
Nov 03 17:27:39.598005 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:39.597948    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9" podStartSLOduration=1.5979331430000001 podStartE2EDuration="1.597933143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:27:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:27:39.595949699 +0000 UTC m=+659.797287754" watchObservedRunningTime="2026-11-03 17:27:39.597933143 +0000 UTC m=+659.799271194"
Nov 03 17:27:39.718178 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:39.718126    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp" podStartSLOduration=2.718108748 podStartE2EDuration="2.718108748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:27:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:27:39.717550785 +0000 UTC m=+659.918888836" watchObservedRunningTime="2026-11-03 17:27:39.718108748 +0000 UTC m=+659.919446801"
Nov 03 17:27:42.466373 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:42.466341    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:27:42.855284 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:42.855245    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"]
Nov 03 17:27:42.860398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:42.860373    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:27:42.915020 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:42.914989    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-2355f4-serving-cert\""
Nov 03 17:27:42.916724 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:42.916694    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"]
Nov 03 17:27:42.975092 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:42.975057    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxcr6\" (UniqueName: \"kubernetes.io/projected/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-kube-api-access-gxcr6\") pod \"maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h\" (UID: \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:27:42.975332 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:42.975135    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-metrics-certs\") pod \"maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h\" (UID: \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:27:42.975332 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:42.975169    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h\" (UID: \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:27:42.975332 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:42.975201    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-maas-api-tls\") pod \"maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h\" (UID: \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:27:43.076630 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:43.076592    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h\" (UID: \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:27:43.076630 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:43.076640    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-maas-api-tls\") pod \"maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h\" (UID: \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:27:43.076898 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:43.076726    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxcr6\" (UniqueName: \"kubernetes.io/projected/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-kube-api-access-gxcr6\") pod \"maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h\" (UID: \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:27:43.076898 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:43.076770    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-metrics-certs\") pod \"maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h\" (UID: \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:27:43.076898 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:27:43.076830    5021 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-serving-cert: secret "maas-api-e2e-worker-w3-2355f4-serving-cert" not found
Nov 03 17:27:43.077040 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:27:43.076920    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-maas-api-tls podName:0ff9164a-f56b-4cbc-a49b-9a7fb21723fd nodeName:}" failed. No retries permitted until 2026-11-03 17:27:43.576897219 +0000 UTC m=+663.778235270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-maas-api-tls") pod "maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h" (UID: "0ff9164a-f56b-4cbc-a49b-9a7fb21723fd") : secret "maas-api-e2e-worker-w3-2355f4-serving-cert" not found
Nov 03 17:27:43.077393 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:43.077373    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h\" (UID: \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:27:43.079146 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:43.079128    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-metrics-certs\") pod \"maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h\" (UID: \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:27:43.142437 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:43.142360    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxcr6\" (UniqueName: \"kubernetes.io/projected/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-kube-api-access-gxcr6\") pod \"maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h\" (UID: \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:27:43.582303 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:43.582265    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-maas-api-tls\") pod \"maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h\" (UID: \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:27:43.584806 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:43.584780    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-maas-api-tls\") pod \"maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h\" (UID: \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:27:43.774301 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:43.774266    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:27:44.151998 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:44.151970    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"]
Nov 03 17:27:44.152794 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:27:44.152770    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff9164a_f56b_4cbc_a49b_9a7fb21723fd.slice/crio-82854593409a468df20f89cfaca139315a4dc174b0cb6c0323dea4b36d05c6a9 WatchSource:0}: Error finding container 82854593409a468df20f89cfaca139315a4dc174b0cb6c0323dea4b36d05c6a9: Status 404 returned error can't find the container with id 82854593409a468df20f89cfaca139315a4dc174b0cb6c0323dea4b36d05c6a9
Nov 03 17:27:44.507394 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:44.507361    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h" event={"ID":"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd","Type":"ContainerStarted","Data":"82854593409a468df20f89cfaca139315a4dc174b0cb6c0323dea4b36d05c6a9"}
Nov 03 17:27:45.515292 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:45.515255    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h" event={"ID":"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd","Type":"ContainerStarted","Data":"1b7e4b3bd6b20d87ddd2859629369ae9261c2497aa6fa84d789519b839a9d9a9"}
Nov 03 17:27:45.515799 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:45.515396    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:27:45.642156 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:45.642100    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h" podStartSLOduration=2.7308737770000002 podStartE2EDuration="3.642084032s" totalImagesPullingTime="911.210255ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:27:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:27:45.640692069 +0000 UTC m=+665.842030118" watchObservedRunningTime="2026-11-03 17:27:45.642084032 +0000 UTC m=+665.843422085"
Nov 03 17:27:46.456076 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:46.456045    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"
Nov 03 17:27:46.456271 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:46.456118    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"
Nov 03 17:27:47.463070 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:47.463037    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"
Nov 03 17:27:48.470282 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:48.470253    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"
Nov 03 17:27:50.486656 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:50.486628    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"
Nov 03 17:27:50.487066 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:50.486785    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"
Nov 03 17:27:51.526542 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:51.526511    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:27:53.630605 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.630565    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"]
Nov 03 17:27:53.635858 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.635829    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.691818 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.691777    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-2355f4-openshift-default-dockercfg-mdxdx\""
Nov 03 17:27:53.745942 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.745910    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"]
Nov 03 17:27:53.795350 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.795318    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-data\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.795501 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.795364    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-credential-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.795501 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.795489    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-podinfo\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.795614 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.795521    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istiod-ca-cert\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.795614 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.795539    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxrdr\" (UniqueName: \"kubernetes.io/projected/5a1ddb65-ca04-4826-afaa-ab3e271011f6-kube-api-access-vxrdr\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.795692 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.795627    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-envoy\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.795692 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.795647    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-workload-certs\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.795692 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.795669    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-token\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.795832 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.795696    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-workload-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.897028 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.896944    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istiod-ca-cert\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.897028 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.896977    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxrdr\" (UniqueName: \"kubernetes.io/projected/5a1ddb65-ca04-4826-afaa-ab3e271011f6-kube-api-access-vxrdr\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.897028 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.897016    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-envoy\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.897370 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.897035    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-workload-certs\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.897370 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.897062    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-token\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.897370 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.897088    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-workload-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.897370 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.897127    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-data\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.897370 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.897177    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-credential-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.897370 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.897291    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-podinfo\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.897657 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.897635    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-workload-certs\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.897715 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.897673    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-credential-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.897767 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.897729    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-workload-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.897822 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.897763    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-data\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.897822 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.897779    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istiod-ca-cert\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.899419 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.899396    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-envoy\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.899672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.899651    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-podinfo\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.961461 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.961425    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-token\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:53.965254 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:53.965209    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxrdr\" (UniqueName: \"kubernetes.io/projected/5a1ddb65-ca04-4826-afaa-ab3e271011f6-kube-api-access-vxrdr\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:54.249371 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:54.249294    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:54.686724 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:54.686696    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"]
Nov 03 17:27:54.687312 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:27:54.687286    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1ddb65_ca04_4826_afaa_ab3e271011f6.slice/crio-9f9dcf7f51cabbf5a5fcc1dcf285b88187334824a6582267b3243a52a2cb225a WatchSource:0}: Error finding container 9f9dcf7f51cabbf5a5fcc1dcf285b88187334824a6582267b3243a52a2cb225a: Status 404 returned error can't find the container with id 9f9dcf7f51cabbf5a5fcc1dcf285b88187334824a6582267b3243a52a2cb225a
Nov 03 17:27:54.689535 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:54.689501    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:27:54.689615 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:54.689568    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:27:54.689615 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:54.689595    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:27:55.585983 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:55.585944    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq" event={"ID":"5a1ddb65-ca04-4826-afaa-ab3e271011f6","Type":"ContainerStarted","Data":"68ddbec63dd4031eb32d8baafd9c999cb74c0c678f53b61c8576ecd1979e5199"}
Nov 03 17:27:55.586191 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:55.586003    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq" event={"ID":"5a1ddb65-ca04-4826-afaa-ab3e271011f6","Type":"ContainerStarted","Data":"9f9dcf7f51cabbf5a5fcc1dcf285b88187334824a6582267b3243a52a2cb225a"}
Nov 03 17:27:55.820397 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:55.820344    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq" podStartSLOduration=2.820328994 podStartE2EDuration="2.820328994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:27:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:27:55.767294508 +0000 UTC m=+675.968632560" watchObservedRunningTime="2026-11-03 17:27:55.820328994 +0000 UTC m=+676.021667046"
Nov 03 17:27:56.249837 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:56.249807    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:27:56.251401 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:56.251369    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Nov 03 17:27:56.251533 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:56.251448    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq" podUID="5a1ddb65-ca04-4826-afaa-ab3e271011f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Nov 03 17:27:57.249739 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:57.249700    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Nov 03 17:27:57.250272 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:57.249776    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq" podUID="5a1ddb65-ca04-4826-afaa-ab3e271011f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Nov 03 17:27:58.256312 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:58.256268    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Nov 03 17:27:58.256707 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:58.256338    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq" podUID="5a1ddb65-ca04-4826-afaa-ab3e271011f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Nov 03 17:27:59.250694 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:59.250651    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Nov 03 17:27:59.251000 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:27:59.250958    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq" podUID="5a1ddb65-ca04-4826-afaa-ab3e271011f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Nov 03 17:28:00.256657 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:00.256618    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Nov 03 17:28:00.257311 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:00.257278    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq" podUID="5a1ddb65-ca04-4826-afaa-ab3e271011f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Nov 03 17:28:01.277670 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:01.277629    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:28:01.279673 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:01.279648    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:28:01.280731 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:01.280706    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:28:07.048496 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:28:07.048425    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:28:13.405420 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:13.405371    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-krxb6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 17:28:13.405954 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:13.405448    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6" podUID="480f6089-e4b0-41a1-be62-83d1d44f0eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 17:28:14.351580 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.351544    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"]
Nov 03 17:28:14.358852 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.358835    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.438855 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.438827    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"]
Nov 03 17:28:14.477104 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.477071    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.477104 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.477108    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.477313 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.477128    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.477313 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.477296    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.477386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.477331    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.477386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.477348    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.477474 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.477461    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.477509 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.477490    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79dss\" (UniqueName: \"kubernetes.io/projected/54ad6a25-5ebf-4333-85ee-2a32e01c785a-kube-api-access-79dss\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.477571 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.477546    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.578631 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.578593    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.578819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.578638    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.578819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.578655    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.578819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.578696    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.578819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.578728    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79dss\" (UniqueName: \"kubernetes.io/projected/54ad6a25-5ebf-4333-85ee-2a32e01c785a-kube-api-access-79dss\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.579018 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.578881    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.579075 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.579041    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.579133 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.579077    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.579133 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.579104    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.579133 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.579111    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.579294 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.579164    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.579431 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.579410    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.579475 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.579454    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.579741 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.579724    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.580997 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.580971    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.581104 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.581023    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.642552 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.642480    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.643066 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.643044    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79dss\" (UniqueName: \"kubernetes.io/projected/54ad6a25-5ebf-4333-85ee-2a32e01c785a-kube-api-access-79dss\") pod \"maas-default-gateway-openshift-default-58c6585447-7ht4p\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:14.672566 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:14.672534    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:15.105706 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:28:15.105679    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ad6a25_5ebf_4333_85ee_2a32e01c785a.slice/crio-3ff25e16c60440a3f7ff495297bc0dc44749d289ea79623eb5264f6d8526d1c9 WatchSource:0}: Error finding container 3ff25e16c60440a3f7ff495297bc0dc44749d289ea79623eb5264f6d8526d1c9: Status 404 returned error can't find the container with id 3ff25e16c60440a3f7ff495297bc0dc44749d289ea79623eb5264f6d8526d1c9
Nov 03 17:28:15.106651 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:15.106628    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"]
Nov 03 17:28:15.108351 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:15.108323    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:28:15.108440 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:15.108384    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:28:15.108440 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:15.108409    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:28:15.713073 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:15.713028    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p" event={"ID":"54ad6a25-5ebf-4333-85ee-2a32e01c785a","Type":"ContainerStarted","Data":"c5dccd5565b7061efe22f258a78b8f9086ecb6d451b8ac9f7c2e49e7f9c245b3"}
Nov 03 17:28:15.713605 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:15.713148    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p" event={"ID":"54ad6a25-5ebf-4333-85ee-2a32e01c785a","Type":"ContainerStarted","Data":"3ff25e16c60440a3f7ff495297bc0dc44749d289ea79623eb5264f6d8526d1c9"}
Nov 03 17:28:15.858684 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:15.858613    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p" podStartSLOduration=1.858592506 podStartE2EDuration="1.858592506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:28:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:28:15.854605779 +0000 UTC m=+696.055943834" watchObservedRunningTime="2026-11-03 17:28:15.858592506 +0000 UTC m=+696.059930562"
Nov 03 17:28:16.673116 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:16.673076    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:16.674930 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:16.674899    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ht4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Nov 03 17:28:16.675061 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:16.674962    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p" podUID="54ad6a25-5ebf-4333-85ee-2a32e01c785a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Nov 03 17:28:17.673508 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:17.673469    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ht4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Nov 03 17:28:17.673965 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:17.673536    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p" podUID="54ad6a25-5ebf-4333-85ee-2a32e01c785a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Nov 03 17:28:18.673628 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:18.673590    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ht4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Nov 03 17:28:18.674012 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:18.673650    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p" podUID="54ad6a25-5ebf-4333-85ee-2a32e01c785a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Nov 03 17:28:19.673376 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:19.673342    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ht4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Nov 03 17:28:19.673547 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:19.673411    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p" podUID="54ad6a25-5ebf-4333-85ee-2a32e01c785a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Nov 03 17:28:20.673680 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:20.673642    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ht4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Nov 03 17:28:20.674095 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:20.673705    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p" podUID="54ad6a25-5ebf-4333-85ee-2a32e01c785a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Nov 03 17:28:21.673407 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:21.673367    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ht4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Nov 03 17:28:21.673689 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:21.673656    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p" podUID="54ad6a25-5ebf-4333-85ee-2a32e01c785a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Nov 03 17:28:22.673252 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:22.673182    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ht4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Nov 03 17:28:22.673671 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:22.673304    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p" podUID="54ad6a25-5ebf-4333-85ee-2a32e01c785a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Nov 03 17:28:24.490579 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:24.490545    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:24.491265 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:24.491212    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:24.492081 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:24.492061    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 17:28:30.949636 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:30.949601    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"]
Nov 03 17:28:30.953858 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:30.953837    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"
Nov 03 17:28:30.977699 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:30.977667    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cd6d68d-3f3e-49f4-a643-39cd05d6d72e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5\" (UID: \"4cd6d68d-3f3e-49f4-a643-39cd05d6d72e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"
Nov 03 17:28:30.977820 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:30.977715    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdmk7\" (UniqueName: \"kubernetes.io/projected/4cd6d68d-3f3e-49f4-a643-39cd05d6d72e-kube-api-access-jdmk7\") pod \"payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5\" (UID: \"4cd6d68d-3f3e-49f4-a643-39cd05d6d72e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"
Nov 03 17:28:31.011686 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.011648    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"]
Nov 03 17:28:31.059340 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.059302    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w4-af9e3c\""
Nov 03 17:28:31.059515 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.059436    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w4-af9e3c-dockercfg-nhn8k\""
Nov 03 17:28:31.079097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.079054    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cd6d68d-3f3e-49f4-a643-39cd05d6d72e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5\" (UID: \"4cd6d68d-3f3e-49f4-a643-39cd05d6d72e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"
Nov 03 17:28:31.079338 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.079310    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdmk7\" (UniqueName: \"kubernetes.io/projected/4cd6d68d-3f3e-49f4-a643-39cd05d6d72e-kube-api-access-jdmk7\") pod \"payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5\" (UID: \"4cd6d68d-3f3e-49f4-a643-39cd05d6d72e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"
Nov 03 17:28:31.081432 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.081406    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cd6d68d-3f3e-49f4-a643-39cd05d6d72e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5\" (UID: \"4cd6d68d-3f3e-49f4-a643-39cd05d6d72e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"
Nov 03 17:28:31.147023 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.146986    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdmk7\" (UniqueName: \"kubernetes.io/projected/4cd6d68d-3f3e-49f4-a643-39cd05d6d72e-kube-api-access-jdmk7\") pod \"payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5\" (UID: \"4cd6d68d-3f3e-49f4-a643-39cd05d6d72e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"
Nov 03 17:28:31.268061 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.268022    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"
Nov 03 17:28:31.656898 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.656442    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"]
Nov 03 17:28:31.659190 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:28:31.659160    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd6d68d_3f3e_49f4_a643_39cd05d6d72e.slice/crio-542e8e5d84fec02acbf20fc6878c0c33cd6cec0459b2f430cd00c27470255b28 WatchSource:0}: Error finding container 542e8e5d84fec02acbf20fc6878c0c33cd6cec0459b2f430cd00c27470255b28: Status 404 returned error can't find the container with id 542e8e5d84fec02acbf20fc6878c0c33cd6cec0459b2f430cd00c27470255b28
Nov 03 17:28:31.770698 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.770662    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"]
Nov 03 17:28:31.774645 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.774620    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:28:31.786916 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.786891    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4371accb-31eb-4f49-a6e2-4a7550d33f15-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9\" (UID: \"4371accb-31eb-4f49-a6e2-4a7550d33f15\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:28:31.787034 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.786933    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4371accb-31eb-4f49-a6e2-4a7550d33f15-metrics-certs\") pod \"maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9\" (UID: \"4371accb-31eb-4f49-a6e2-4a7550d33f15\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:28:31.787117 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.787093    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8xj8\" (UniqueName: \"kubernetes.io/projected/4371accb-31eb-4f49-a6e2-4a7550d33f15-kube-api-access-b8xj8\") pod \"maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9\" (UID: \"4371accb-31eb-4f49-a6e2-4a7550d33f15\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:28:31.787158 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.787140    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4371accb-31eb-4f49-a6e2-4a7550d33f15-maas-api-tls\") pod \"maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9\" (UID: \"4371accb-31eb-4f49-a6e2-4a7550d33f15\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:28:31.828948 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.828916    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-praxis-b-3e5c4d-serving-cert\""
Nov 03 17:28:31.831133 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.831102    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"]
Nov 03 17:28:31.842275 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.840542    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5" event={"ID":"4cd6d68d-3f3e-49f4-a643-39cd05d6d72e","Type":"ContainerStarted","Data":"c4736202aec4abf06da00eda4f1f6a946713617b7983ae68ca057fd083fa6b70"}
Nov 03 17:28:31.842275 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.840602    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5" event={"ID":"4cd6d68d-3f3e-49f4-a643-39cd05d6d72e","Type":"ContainerStarted","Data":"542e8e5d84fec02acbf20fc6878c0c33cd6cec0459b2f430cd00c27470255b28"}
Nov 03 17:28:31.842275 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.840633    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"
Nov 03 17:28:31.888686 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.888652    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4371accb-31eb-4f49-a6e2-4a7550d33f15-metrics-certs\") pod \"maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9\" (UID: \"4371accb-31eb-4f49-a6e2-4a7550d33f15\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:28:31.888922 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.888817    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8xj8\" (UniqueName: \"kubernetes.io/projected/4371accb-31eb-4f49-a6e2-4a7550d33f15-kube-api-access-b8xj8\") pod \"maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9\" (UID: \"4371accb-31eb-4f49-a6e2-4a7550d33f15\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:28:31.888922 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.888868    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4371accb-31eb-4f49-a6e2-4a7550d33f15-maas-api-tls\") pod \"maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9\" (UID: \"4371accb-31eb-4f49-a6e2-4a7550d33f15\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:28:31.889076 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.888923    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4371accb-31eb-4f49-a6e2-4a7550d33f15-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9\" (UID: \"4371accb-31eb-4f49-a6e2-4a7550d33f15\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:28:31.889746 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.889695    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4371accb-31eb-4f49-a6e2-4a7550d33f15-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9\" (UID: \"4371accb-31eb-4f49-a6e2-4a7550d33f15\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:28:31.889918 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:28:31.889893    5021 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-serving-cert: secret "maas-api-e2e-praxis-b-3e5c4d-serving-cert" not found
Nov 03 17:28:31.890013 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:28:31.889965    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4371accb-31eb-4f49-a6e2-4a7550d33f15-maas-api-tls podName:4371accb-31eb-4f49-a6e2-4a7550d33f15 nodeName:}" failed. No retries permitted until 2026-11-03 17:28:32.389935571 +0000 UTC m=+712.591273617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4371accb-31eb-4f49-a6e2-4a7550d33f15-maas-api-tls") pod "maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9" (UID: "4371accb-31eb-4f49-a6e2-4a7550d33f15") : secret "maas-api-e2e-praxis-b-3e5c4d-serving-cert" not found
Nov 03 17:28:31.892339 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.892311    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4371accb-31eb-4f49-a6e2-4a7550d33f15-metrics-certs\") pod \"maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9\" (UID: \"4371accb-31eb-4f49-a6e2-4a7550d33f15\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:28:31.953265 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:31.953171    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8xj8\" (UniqueName: \"kubernetes.io/projected/4371accb-31eb-4f49-a6e2-4a7550d33f15-kube-api-access-b8xj8\") pod \"maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9\" (UID: \"4371accb-31eb-4f49-a6e2-4a7550d33f15\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:28:32.018679 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:32.018624    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5" podStartSLOduration=2.01860936 podStartE2EDuration="2.01860936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:28:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:28:32.015784519 +0000 UTC m=+712.217122572" watchObservedRunningTime="2026-11-03 17:28:32.01860936 +0000 UTC m=+712.219947412"
Nov 03 17:28:32.393816 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:32.393780    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4371accb-31eb-4f49-a6e2-4a7550d33f15-maas-api-tls\") pod \"maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9\" (UID: \"4371accb-31eb-4f49-a6e2-4a7550d33f15\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:28:32.396317 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:32.396291    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4371accb-31eb-4f49-a6e2-4a7550d33f15-maas-api-tls\") pod \"maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9\" (UID: \"4371accb-31eb-4f49-a6e2-4a7550d33f15\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:28:32.688035 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:32.687936    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:28:33.065591 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:33.065563    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"]
Nov 03 17:28:33.066525 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:28:33.066502    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4371accb_31eb_4f49_a6e2_4a7550d33f15.slice/crio-7e204c1504413219debe6d0d85c1c7cabbd0c9006b8a8c68c0357f3e089f8c5e WatchSource:0}: Error finding container 7e204c1504413219debe6d0d85c1c7cabbd0c9006b8a8c68c0357f3e089f8c5e: Status 404 returned error can't find the container with id 7e204c1504413219debe6d0d85c1c7cabbd0c9006b8a8c68c0357f3e089f8c5e
Nov 03 17:28:33.854286 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:33.854251    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9" event={"ID":"4371accb-31eb-4f49-a6e2-4a7550d33f15","Type":"ContainerStarted","Data":"7e204c1504413219debe6d0d85c1c7cabbd0c9006b8a8c68c0357f3e089f8c5e"}
Nov 03 17:28:34.861376 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:34.861335    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9" event={"ID":"4371accb-31eb-4f49-a6e2-4a7550d33f15","Type":"ContainerStarted","Data":"0a62e052f501832dd2f0e0bb66ecb3f850682d639a262e10e3cfb4dbb1c21ab2"}
Nov 03 17:28:34.861806 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:34.861555    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:28:34.983912 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:34.983861    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9" podStartSLOduration=3.036744924 podStartE2EDuration="3.983846686s" totalImagesPullingTime="947.101762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:28:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:28:34.983049076 +0000 UTC m=+715.184387130" watchObservedRunningTime="2026-11-03 17:28:34.983846686 +0000 UTC m=+715.185184737"
Nov 03 17:28:37.045569 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:28:37.045532    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:28:40.873056 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:40.873022    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:28:42.849296 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:42.849263    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"
Nov 03 17:28:50.257311 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:50.257276    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"]
Nov 03 17:28:50.262453 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:50.262436    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:28:50.317566 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:50.317535    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"]
Nov 03 17:28:50.365618 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:50.365585    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w4-af9e3c-serving-cert\""
Nov 03 17:28:50.382722 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:50.382686    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgt2v\" (UniqueName: \"kubernetes.io/projected/b545b7bb-eadc-432e-aa29-c66ba01b479c-kube-api-access-kgt2v\") pod \"maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br\" (UID: \"b545b7bb-eadc-432e-aa29-c66ba01b479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:28:50.382982 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:50.382962    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b545b7bb-eadc-432e-aa29-c66ba01b479c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br\" (UID: \"b545b7bb-eadc-432e-aa29-c66ba01b479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:28:50.383164 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:50.383147    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b545b7bb-eadc-432e-aa29-c66ba01b479c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br\" (UID: \"b545b7bb-eadc-432e-aa29-c66ba01b479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:28:50.383293 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:50.383278    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b545b7bb-eadc-432e-aa29-c66ba01b479c-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br\" (UID: \"b545b7bb-eadc-432e-aa29-c66ba01b479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:28:50.484120 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:50.484085    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgt2v\" (UniqueName: \"kubernetes.io/projected/b545b7bb-eadc-432e-aa29-c66ba01b479c-kube-api-access-kgt2v\") pod \"maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br\" (UID: \"b545b7bb-eadc-432e-aa29-c66ba01b479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:28:50.484333 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:50.484152    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b545b7bb-eadc-432e-aa29-c66ba01b479c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br\" (UID: \"b545b7bb-eadc-432e-aa29-c66ba01b479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:28:50.484333 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:50.484252    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b545b7bb-eadc-432e-aa29-c66ba01b479c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br\" (UID: \"b545b7bb-eadc-432e-aa29-c66ba01b479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:28:50.484333 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:50.484282    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b545b7bb-eadc-432e-aa29-c66ba01b479c-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br\" (UID: \"b545b7bb-eadc-432e-aa29-c66ba01b479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:28:50.484640 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:28:50.484616    5021 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-serving-cert: secret "maas-api-e2e-shared-a-w4-af9e3c-serving-cert" not found
Nov 03 17:28:50.484750 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:28:50.484685    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b545b7bb-eadc-432e-aa29-c66ba01b479c-maas-api-tls podName:b545b7bb-eadc-432e-aa29-c66ba01b479c nodeName:}" failed. No retries permitted until 2026-11-03 17:28:50.984668252 +0000 UTC m=+731.186006298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b545b7bb-eadc-432e-aa29-c66ba01b479c-maas-api-tls") pod "maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br" (UID: "b545b7bb-eadc-432e-aa29-c66ba01b479c") : secret "maas-api-e2e-shared-a-w4-af9e3c-serving-cert" not found
Nov 03 17:28:50.484929 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:50.484906    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b545b7bb-eadc-432e-aa29-c66ba01b479c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br\" (UID: \"b545b7bb-eadc-432e-aa29-c66ba01b479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:28:50.486745 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:50.486726    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b545b7bb-eadc-432e-aa29-c66ba01b479c-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br\" (UID: \"b545b7bb-eadc-432e-aa29-c66ba01b479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:28:50.549386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:50.549314    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgt2v\" (UniqueName: \"kubernetes.io/projected/b545b7bb-eadc-432e-aa29-c66ba01b479c-kube-api-access-kgt2v\") pod \"maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br\" (UID: \"b545b7bb-eadc-432e-aa29-c66ba01b479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:28:50.990909 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:50.990838    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b545b7bb-eadc-432e-aa29-c66ba01b479c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br\" (UID: \"b545b7bb-eadc-432e-aa29-c66ba01b479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:28:50.993256 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:50.993203    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b545b7bb-eadc-432e-aa29-c66ba01b479c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br\" (UID: \"b545b7bb-eadc-432e-aa29-c66ba01b479c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:28:51.175504 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:51.175468    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:28:51.565631 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:51.565602    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"]
Nov 03 17:28:51.566295 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:28:51.566268    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb545b7bb_eadc_432e_aa29_c66ba01b479c.slice/crio-335303ba6480f753f44df9cb0d75c99e4950b135a35c87c72d4828490f6548ae WatchSource:0}: Error finding container 335303ba6480f753f44df9cb0d75c99e4950b135a35c87c72d4828490f6548ae: Status 404 returned error can't find the container with id 335303ba6480f753f44df9cb0d75c99e4950b135a35c87c72d4828490f6548ae
Nov 03 17:28:51.964067 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:51.963963    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br" event={"ID":"b545b7bb-eadc-432e-aa29-c66ba01b479c","Type":"ContainerStarted","Data":"335303ba6480f753f44df9cb0d75c99e4950b135a35c87c72d4828490f6548ae"}
Nov 03 17:28:52.971357 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:52.971317    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br" event={"ID":"b545b7bb-eadc-432e-aa29-c66ba01b479c","Type":"ContainerStarted","Data":"e63be874e63a4c68b0f1a6c59199c694bb00bb3fa4a812dd803278373c736bff"}
Nov 03 17:28:52.971800 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:52.971489    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:28:53.093717 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:53.093663    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br" podStartSLOduration=2.170920342 podStartE2EDuration="3.093648544s" totalImagesPullingTime="922.728202ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:28:53.093286006 +0000 UTC m=+733.294624056" watchObservedRunningTime="2026-11-03 17:28:53.093648544 +0000 UTC m=+733.294986596"
Nov 03 17:28:58.986117 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:28:58.986077    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:29:07.046307 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:29:07.046272    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:29:37.045996 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:29:37.045956    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:29:41.574848 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:41.574817    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"]
Nov 03 17:29:41.579924 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:41.579907    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"
Nov 03 17:29:41.633426 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:41.633392    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"]
Nov 03 17:29:41.638300 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:41.638274    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w4-147834\""
Nov 03 17:29:41.638658 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:41.638632    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w4-147834-dockercfg-6967d\""
Nov 03 17:29:41.759685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:41.759653    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4c8s\" (UniqueName: \"kubernetes.io/projected/42ebff73-4626-4e33-bf90-035d618e3c43-kube-api-access-m4c8s\") pod \"payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz\" (UID: \"42ebff73-4626-4e33-bf90-035d618e3c43\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"
Nov 03 17:29:41.759878 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:41.759732    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ebff73-4626-4e33-bf90-035d618e3c43-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz\" (UID: \"42ebff73-4626-4e33-bf90-035d618e3c43\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"
Nov 03 17:29:41.860616 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:41.860537    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4c8s\" (UniqueName: \"kubernetes.io/projected/42ebff73-4626-4e33-bf90-035d618e3c43-kube-api-access-m4c8s\") pod \"payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz\" (UID: \"42ebff73-4626-4e33-bf90-035d618e3c43\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"
Nov 03 17:29:41.860789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:41.860619    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ebff73-4626-4e33-bf90-035d618e3c43-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz\" (UID: \"42ebff73-4626-4e33-bf90-035d618e3c43\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"
Nov 03 17:29:41.861332 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:41.861311    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ebff73-4626-4e33-bf90-035d618e3c43-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz\" (UID: \"42ebff73-4626-4e33-bf90-035d618e3c43\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"
Nov 03 17:29:41.905561 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:41.905520    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7478-3c1abe"]
Nov 03 17:29:41.909444 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:41.909419    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7478-3c1abe"
Nov 03 17:29:41.929434 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:41.929406    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4c8s\" (UniqueName: \"kubernetes.io/projected/42ebff73-4626-4e33-bf90-035d618e3c43-kube-api-access-m4c8s\") pod \"payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz\" (UID: \"42ebff73-4626-4e33-bf90-035d618e3c43\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"
Nov 03 17:29:41.961710 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:41.961679    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7478-3c1abe"]
Nov 03 17:29:41.963702 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:41.963681    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hjccf\""
Nov 03 17:29:42.062920 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:42.062855    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgrr8\" (UniqueName: \"kubernetes.io/projected/02de86eb-d80b-4398-9c2f-b38453be1df4-kube-api-access-pgrr8\") pod \"test-curl-7478-3c1abe\" (UID: \"02de86eb-d80b-4398-9c2f-b38453be1df4\") " pod="opendatahub/test-curl-7478-3c1abe"
Nov 03 17:29:42.164356 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:42.164270    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgrr8\" (UniqueName: \"kubernetes.io/projected/02de86eb-d80b-4398-9c2f-b38453be1df4-kube-api-access-pgrr8\") pod \"test-curl-7478-3c1abe\" (UID: \"02de86eb-d80b-4398-9c2f-b38453be1df4\") " pod="opendatahub/test-curl-7478-3c1abe"
Nov 03 17:29:42.193109 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:42.193054    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"
Nov 03 17:29:42.227352 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:42.227321    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgrr8\" (UniqueName: \"kubernetes.io/projected/02de86eb-d80b-4398-9c2f-b38453be1df4-kube-api-access-pgrr8\") pod \"test-curl-7478-3c1abe\" (UID: \"02de86eb-d80b-4398-9c2f-b38453be1df4\") " pod="opendatahub/test-curl-7478-3c1abe"
Nov 03 17:29:42.521967 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:42.521938    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7478-3c1abe"
Nov 03 17:29:42.582391 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:42.581998    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"]
Nov 03 17:29:42.583170 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:29:42.583142    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ebff73_4626_4e33_bf90_035d618e3c43.slice/crio-71c28c71078224ca4b26266778fe40ff0ab0d4dc34aae6ff0897b98eac774beb WatchSource:0}: Error finding container 71c28c71078224ca4b26266778fe40ff0ab0d4dc34aae6ff0897b98eac774beb: Status 404 returned error can't find the container with id 71c28c71078224ca4b26266778fe40ff0ab0d4dc34aae6ff0897b98eac774beb
Nov 03 17:29:42.898456 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:42.898191    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7478-3c1abe"]
Nov 03 17:29:42.901612 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:29:42.901580    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02de86eb_d80b_4398_9c2f_b38453be1df4.slice/crio-ce0a61499c42cef8e31ab4aac71cd3eeead1433f04e0a0b6fdbbc898adfe8cb2 WatchSource:0}: Error finding container ce0a61499c42cef8e31ab4aac71cd3eeead1433f04e0a0b6fdbbc898adfe8cb2: Status 404 returned error can't find the container with id ce0a61499c42cef8e31ab4aac71cd3eeead1433f04e0a0b6fdbbc898adfe8cb2
Nov 03 17:29:43.336390 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:43.336352    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7478-3c1abe" event={"ID":"02de86eb-d80b-4398-9c2f-b38453be1df4","Type":"ContainerStarted","Data":"ce0a61499c42cef8e31ab4aac71cd3eeead1433f04e0a0b6fdbbc898adfe8cb2"}
Nov 03 17:29:43.337992 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:43.337961    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz" event={"ID":"42ebff73-4626-4e33-bf90-035d618e3c43","Type":"ContainerStarted","Data":"51435bde223c86b4ca56efe6ae86e56fa8837fa600aaeab195ce652eef1881d5"}
Nov 03 17:29:43.338126 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:43.338010    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz" event={"ID":"42ebff73-4626-4e33-bf90-035d618e3c43","Type":"ContainerStarted","Data":"71c28c71078224ca4b26266778fe40ff0ab0d4dc34aae6ff0897b98eac774beb"}
Nov 03 17:29:43.338126 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:43.338104    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"
Nov 03 17:29:43.502648 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:43.502594    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz" podStartSLOduration=2.50258022 podStartE2EDuration="2.50258022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:29:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:29:43.500180093 +0000 UTC m=+783.701518145" watchObservedRunningTime="2026-11-03 17:29:43.50258022 +0000 UTC m=+783.703918271"
Nov 03 17:29:45.351551 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:45.351515    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7478-3c1abe" event={"ID":"02de86eb-d80b-4398-9c2f-b38453be1df4","Type":"ContainerStarted","Data":"f9968cd6c17ec3ddcd3b941b50f8947f55bc22f9c7abb2cc4d6533c2c91b48b8"}
Nov 03 17:29:45.472242 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:45.472182    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7478-3c1abe" podStartSLOduration=2.867684703 podStartE2EDuration="4.472166303s" totalImagesPullingTime="1.6044816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:29:45.470089392 +0000 UTC m=+785.671427445" watchObservedRunningTime="2026-11-03 17:29:45.472166303 +0000 UTC m=+785.673504355"
Nov 03 17:29:46.948685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:46.948649    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7478-3c1abe"]
Nov 03 17:29:46.953395 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:46.953150    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7478-3c1abe"]
Nov 03 17:29:47.163023 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:47.162989    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7478-dc75e7"]
Nov 03 17:29:47.164097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:47.164068    5021 cpu_manager.go:414] "containerMap: removing container" podUID="02de86eb-d80b-4398-9c2f-b38453be1df4" containerName="test-curl-7478-3c1abe"
Nov 03 17:29:47.164293 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:47.164275    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="02de86eb-d80b-4398-9c2f-b38453be1df4" containerName="test-curl-7478-3c1abe"
Nov 03 17:29:47.164576 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:47.164561    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="02de86eb-d80b-4398-9c2f-b38453be1df4" containerName="test-curl-7478-3c1abe"
Nov 03 17:29:47.169127 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:47.169104    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7478-dc75e7"
Nov 03 17:29:47.189244 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:47.186524    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7478-dc75e7"]
Nov 03 17:29:47.243334 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:47.237275    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6z4p\" (UniqueName: \"kubernetes.io/projected/c8eec92c-927f-4c42-89ee-aae368576780-kube-api-access-v6z4p\") pod \"test-curl-7478-dc75e7\" (UID: \"c8eec92c-927f-4c42-89ee-aae368576780\") " pod="opendatahub/test-curl-7478-dc75e7"
Nov 03 17:29:47.338076 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:47.338038    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6z4p\" (UniqueName: \"kubernetes.io/projected/c8eec92c-927f-4c42-89ee-aae368576780-kube-api-access-v6z4p\") pod \"test-curl-7478-dc75e7\" (UID: \"c8eec92c-927f-4c42-89ee-aae368576780\") " pod="opendatahub/test-curl-7478-dc75e7"
Nov 03 17:29:47.365492 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:47.365449    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7478-3c1abe" podUID="02de86eb-d80b-4398-9c2f-b38453be1df4" containerName="test-curl-7478-3c1abe" containerID="cri-o://f9968cd6c17ec3ddcd3b941b50f8947f55bc22f9c7abb2cc4d6533c2c91b48b8" gracePeriod=2
Nov 03 17:29:47.401377 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:47.401337    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6z4p\" (UniqueName: \"kubernetes.io/projected/c8eec92c-927f-4c42-89ee-aae368576780-kube-api-access-v6z4p\") pod \"test-curl-7478-dc75e7\" (UID: \"c8eec92c-927f-4c42-89ee-aae368576780\") " pod="opendatahub/test-curl-7478-dc75e7"
Nov 03 17:29:47.419000 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:29:47.418965    5021 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7478-3c1abe\" is forbidden: User \"system:node:ip-10-0-137-219.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-219.us-west-2.compute.internal' and this object" podUID="02de86eb-d80b-4398-9c2f-b38453be1df4" pod="opendatahub/test-curl-7478-3c1abe"
Nov 03 17:29:47.555015 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:47.554987    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7478-dc75e7"
Nov 03 17:29:47.934645 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:47.934615    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7478-dc75e7"]
Nov 03 17:29:47.935287 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:29:47.935258    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8eec92c_927f_4c42_89ee_aae368576780.slice/crio-586cfc04def03c2eebfb9985ae0ac8cad50bb2ab724d59675a5f7b5660554c21 WatchSource:0}: Error finding container 586cfc04def03c2eebfb9985ae0ac8cad50bb2ab724d59675a5f7b5660554c21: Status 404 returned error can't find the container with id 586cfc04def03c2eebfb9985ae0ac8cad50bb2ab724d59675a5f7b5660554c21
Nov 03 17:29:48.372291 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:48.372252    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7478-dc75e7" event={"ID":"c8eec92c-927f-4c42-89ee-aae368576780","Type":"ContainerStarted","Data":"aa33a447ebc1ec341e27c473b280dea5793a8d6e06e503c052cf3205a5286a4e"}
Nov 03 17:29:48.372291 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:48.372299    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7478-dc75e7" event={"ID":"c8eec92c-927f-4c42-89ee-aae368576780","Type":"ContainerStarted","Data":"586cfc04def03c2eebfb9985ae0ac8cad50bb2ab724d59675a5f7b5660554c21"}
Nov 03 17:29:48.493507 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:48.493454    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7478-dc75e7" podStartSLOduration=1.4934385940000001 podStartE2EDuration="1.493438594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:29:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:29:48.492504405 +0000 UTC m=+788.693842454" watchObservedRunningTime="2026-11-03 17:29:48.493438594 +0000 UTC m=+788.694776646"
Nov 03 17:29:49.570871 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:49.570842    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7478-3c1abe"
Nov 03 17:29:49.668735 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:49.668653    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/02de86eb-d80b-4398-9c2f-b38453be1df4-kube-api-access-pgrr8\" (UniqueName: \"kubernetes.io/projected/02de86eb-d80b-4398-9c2f-b38453be1df4-kube-api-access-pgrr8\") pod \"02de86eb-d80b-4398-9c2f-b38453be1df4\" (UID: \"02de86eb-d80b-4398-9c2f-b38453be1df4\") "
Nov 03 17:29:49.670923 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:49.670889    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02de86eb-d80b-4398-9c2f-b38453be1df4-kube-api-access-pgrr8" pod "02de86eb-d80b-4398-9c2f-b38453be1df4" (UID: "02de86eb-d80b-4398-9c2f-b38453be1df4"). InnerVolumeSpecName "kube-api-access-pgrr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:29:49.770420 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:49.770386    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgrr8\" (UniqueName: \"kubernetes.io/projected/02de86eb-d80b-4398-9c2f-b38453be1df4-kube-api-access-pgrr8\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:29:50.004594 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:50.004569    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="02de86eb-d80b-4398-9c2f-b38453be1df4" path="/var/lib/kubelet/pods/02de86eb-d80b-4398-9c2f-b38453be1df4/volumes"
Nov 03 17:29:50.303292 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:50.303197    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7478-dc75e7"]
Nov 03 17:29:50.307214 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:50.307187    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7478-dc75e7"]
Nov 03 17:29:50.385283 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:50.385215    5021 generic.go:356] "Generic (PLEG): container finished" podID="02de86eb-d80b-4398-9c2f-b38453be1df4" containerID="f9968cd6c17ec3ddcd3b941b50f8947f55bc22f9c7abb2cc4d6533c2c91b48b8" exitCode=137
Nov 03 17:29:50.385283 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:50.385288    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7478-3c1abe"
Nov 03 17:29:50.385536 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:50.385313    5021 scope.go:122] "RemoveContainer" containerID="f9968cd6c17ec3ddcd3b941b50f8947f55bc22f9c7abb2cc4d6533c2c91b48b8"
Nov 03 17:29:50.385536 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:50.385486    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7478-dc75e7" podUID="c8eec92c-927f-4c42-89ee-aae368576780" containerName="test-curl-7478-dc75e7" containerID="cri-o://aa33a447ebc1ec341e27c473b280dea5793a8d6e06e503c052cf3205a5286a4e" gracePeriod=2
Nov 03 17:29:50.394195 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:50.394178    5021 scope.go:122] "RemoveContainer" containerID="f9968cd6c17ec3ddcd3b941b50f8947f55bc22f9c7abb2cc4d6533c2c91b48b8"
Nov 03 17:29:50.394463 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:29:50.394445    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9968cd6c17ec3ddcd3b941b50f8947f55bc22f9c7abb2cc4d6533c2c91b48b8\": container with ID starting with f9968cd6c17ec3ddcd3b941b50f8947f55bc22f9c7abb2cc4d6533c2c91b48b8 not found: ID does not exist" containerID="f9968cd6c17ec3ddcd3b941b50f8947f55bc22f9c7abb2cc4d6533c2c91b48b8"
Nov 03 17:29:50.394507 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:50.394472    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9968cd6c17ec3ddcd3b941b50f8947f55bc22f9c7abb2cc4d6533c2c91b48b8"} err="failed to get container status \"f9968cd6c17ec3ddcd3b941b50f8947f55bc22f9c7abb2cc4d6533c2c91b48b8\": rpc error: code = NotFound desc = could not find container \"f9968cd6c17ec3ddcd3b941b50f8947f55bc22f9c7abb2cc4d6533c2c91b48b8\": container with ID starting with f9968cd6c17ec3ddcd3b941b50f8947f55bc22f9c7abb2cc4d6533c2c91b48b8 not found: ID does not exist"
Nov 03 17:29:50.439029 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:29:50.438993    5021 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7478-dc75e7\" is forbidden: User \"system:node:ip-10-0-137-219.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-219.us-west-2.compute.internal' and this object" podUID="c8eec92c-927f-4c42-89ee-aae368576780" pod="opendatahub/test-curl-7478-dc75e7"
Nov 03 17:29:50.492180 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:29:50.492139    5021 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7478-dc75e7\" is forbidden: User \"system:node:ip-10-0-137-219.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-219.us-west-2.compute.internal' and this object" podUID="c8eec92c-927f-4c42-89ee-aae368576780" pod="opendatahub/test-curl-7478-dc75e7"
Nov 03 17:29:52.642762 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:52.642698    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7478-dc75e7"
Nov 03 17:29:52.698732 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:52.698703    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8eec92c-927f-4c42-89ee-aae368576780-kube-api-access-v6z4p\" (UniqueName: \"kubernetes.io/projected/c8eec92c-927f-4c42-89ee-aae368576780-kube-api-access-v6z4p\") pod \"c8eec92c-927f-4c42-89ee-aae368576780\" (UID: \"c8eec92c-927f-4c42-89ee-aae368576780\") "
Nov 03 17:29:52.700773 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:52.700748    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8eec92c-927f-4c42-89ee-aae368576780-kube-api-access-v6z4p" pod "c8eec92c-927f-4c42-89ee-aae368576780" (UID: "c8eec92c-927f-4c42-89ee-aae368576780"). InnerVolumeSpecName "kube-api-access-v6z4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:29:52.800216 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:52.800165    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6z4p\" (UniqueName: \"kubernetes.io/projected/c8eec92c-927f-4c42-89ee-aae368576780-kube-api-access-v6z4p\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:29:53.406177 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:53.406141    5021 generic.go:356] "Generic (PLEG): container finished" podID="c8eec92c-927f-4c42-89ee-aae368576780" containerID="aa33a447ebc1ec341e27c473b280dea5793a8d6e06e503c052cf3205a5286a4e" exitCode=137
Nov 03 17:29:53.406350 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:53.406188    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7478-dc75e7"
Nov 03 17:29:53.406350 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:53.406257    5021 scope.go:122] "RemoveContainer" containerID="aa33a447ebc1ec341e27c473b280dea5793a8d6e06e503c052cf3205a5286a4e"
Nov 03 17:29:53.416557 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:53.416536    5021 scope.go:122] "RemoveContainer" containerID="aa33a447ebc1ec341e27c473b280dea5793a8d6e06e503c052cf3205a5286a4e"
Nov 03 17:29:53.416804 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:29:53.416784    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa33a447ebc1ec341e27c473b280dea5793a8d6e06e503c052cf3205a5286a4e\": container with ID starting with aa33a447ebc1ec341e27c473b280dea5793a8d6e06e503c052cf3205a5286a4e not found: ID does not exist" containerID="aa33a447ebc1ec341e27c473b280dea5793a8d6e06e503c052cf3205a5286a4e"
Nov 03 17:29:53.416865 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:53.416814    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa33a447ebc1ec341e27c473b280dea5793a8d6e06e503c052cf3205a5286a4e"} err="failed to get container status \"aa33a447ebc1ec341e27c473b280dea5793a8d6e06e503c052cf3205a5286a4e\": rpc error: code = NotFound desc = could not find container \"aa33a447ebc1ec341e27c473b280dea5793a8d6e06e503c052cf3205a5286a4e\": container with ID starting with aa33a447ebc1ec341e27c473b280dea5793a8d6e06e503c052cf3205a5286a4e not found: ID does not exist"
Nov 03 17:29:53.468366 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:29:53.468327    5021 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7478-dc75e7\" is forbidden: User \"system:node:ip-10-0-137-219.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-219.us-west-2.compute.internal' and this object" podUID="c8eec92c-927f-4c42-89ee-aae368576780" pod="opendatahub/test-curl-7478-dc75e7"
Nov 03 17:29:54.003667 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:54.003636    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8eec92c-927f-4c42-89ee-aae368576780" path="/var/lib/kubelet/pods/c8eec92c-927f-4c42-89ee-aae368576780/volumes"
Nov 03 17:29:54.346681 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:29:54.346606    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"
Nov 03 17:30:00.419541 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.419503    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"]
Nov 03 17:30:00.420484 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.420461    5021 cpu_manager.go:414] "containerMap: removing container" podUID="c8eec92c-927f-4c42-89ee-aae368576780" containerName="test-curl-7478-dc75e7"
Nov 03 17:30:00.420484 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.420491    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8eec92c-927f-4c42-89ee-aae368576780" containerName="test-curl-7478-dc75e7"
Nov 03 17:30:00.420673 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.420638    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8eec92c-927f-4c42-89ee-aae368576780" containerName="test-curl-7478-dc75e7"
Nov 03 17:30:00.425828 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.425801    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"
Nov 03 17:30:00.478783 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.478751    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"]
Nov 03 17:30:00.480191 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.480162    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd9016e5-9676-4809-a81d-8f8aa1d08c8b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh\" (UID: \"cd9016e5-9676-4809-a81d-8f8aa1d08c8b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"
Nov 03 17:30:00.480387 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.480361    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6gv7\" (UniqueName: \"kubernetes.io/projected/cd9016e5-9676-4809-a81d-8f8aa1d08c8b-kube-api-access-k6gv7\") pod \"payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh\" (UID: \"cd9016e5-9676-4809-a81d-8f8aa1d08c8b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"
Nov 03 17:30:00.527533 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.527496    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-3f1cf1\""
Nov 03 17:30:00.527533 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.527497    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-3f1cf1-dockercfg-cdkcn\""
Nov 03 17:30:00.581961 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.581925    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd9016e5-9676-4809-a81d-8f8aa1d08c8b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh\" (UID: \"cd9016e5-9676-4809-a81d-8f8aa1d08c8b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"
Nov 03 17:30:00.582151 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.582047    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6gv7\" (UniqueName: \"kubernetes.io/projected/cd9016e5-9676-4809-a81d-8f8aa1d08c8b-kube-api-access-k6gv7\") pod \"payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh\" (UID: \"cd9016e5-9676-4809-a81d-8f8aa1d08c8b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"
Nov 03 17:30:00.582877 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.582855    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd9016e5-9676-4809-a81d-8f8aa1d08c8b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh\" (UID: \"cd9016e5-9676-4809-a81d-8f8aa1d08c8b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"
Nov 03 17:30:00.598734 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.598705    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"]
Nov 03 17:30:00.602765 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.602748    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"
Nov 03 17:30:00.646607 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.646575    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6gv7\" (UniqueName: \"kubernetes.io/projected/cd9016e5-9676-4809-a81d-8f8aa1d08c8b-kube-api-access-k6gv7\") pod \"payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh\" (UID: \"cd9016e5-9676-4809-a81d-8f8aa1d08c8b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"
Nov 03 17:30:00.670525 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.670454    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"]
Nov 03 17:30:00.683195 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.683165    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdnnl\" (UniqueName: \"kubernetes.io/projected/dabcf1df-5d48-4e4b-8491-288ad2dfd279-kube-api-access-cdnnl\") pod \"payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg\" (UID: \"dabcf1df-5d48-4e4b-8491-288ad2dfd279\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"
Nov 03 17:30:00.683367 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.683330    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dabcf1df-5d48-4e4b-8491-288ad2dfd279-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg\" (UID: \"dabcf1df-5d48-4e4b-8491-288ad2dfd279\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"
Nov 03 17:30:00.746439 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.746407    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"
Nov 03 17:30:00.784361 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.784324    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdnnl\" (UniqueName: \"kubernetes.io/projected/dabcf1df-5d48-4e4b-8491-288ad2dfd279-kube-api-access-cdnnl\") pod \"payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg\" (UID: \"dabcf1df-5d48-4e4b-8491-288ad2dfd279\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"
Nov 03 17:30:00.784520 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.784425    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dabcf1df-5d48-4e4b-8491-288ad2dfd279-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg\" (UID: \"dabcf1df-5d48-4e4b-8491-288ad2dfd279\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"
Nov 03 17:30:00.785375 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.785348    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dabcf1df-5d48-4e4b-8491-288ad2dfd279-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg\" (UID: \"dabcf1df-5d48-4e4b-8491-288ad2dfd279\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"
Nov 03 17:30:00.848419 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.848390    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdnnl\" (UniqueName: \"kubernetes.io/projected/dabcf1df-5d48-4e4b-8491-288ad2dfd279-kube-api-access-cdnnl\") pod \"payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg\" (UID: \"dabcf1df-5d48-4e4b-8491-288ad2dfd279\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"
Nov 03 17:30:00.916137 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:00.916104    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"
Nov 03 17:30:01.126677 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:30:01.126644    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd9016e5_9676_4809_a81d_8f8aa1d08c8b.slice/crio-d7a1a15d3ee123b47ebf076018d833a7cefef1c8eba47fa3e9a9ad79d44886cd WatchSource:0}: Error finding container d7a1a15d3ee123b47ebf076018d833a7cefef1c8eba47fa3e9a9ad79d44886cd: Status 404 returned error can't find the container with id d7a1a15d3ee123b47ebf076018d833a7cefef1c8eba47fa3e9a9ad79d44886cd
Nov 03 17:30:01.127215 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.127177    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"]
Nov 03 17:30:01.306436 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.306410    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"]
Nov 03 17:30:01.307501 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:30:01.307467    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddabcf1df_5d48_4e4b_8491_288ad2dfd279.slice/crio-8893c552e4a7fdaf070b1bdac780484170097187a21137087f958fa48815e902 WatchSource:0}: Error finding container 8893c552e4a7fdaf070b1bdac780484170097187a21137087f958fa48815e902: Status 404 returned error can't find the container with id 8893c552e4a7fdaf070b1bdac780484170097187a21137087f958fa48815e902
Nov 03 17:30:01.456837 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.456736    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg" event={"ID":"dabcf1df-5d48-4e4b-8491-288ad2dfd279","Type":"ContainerStarted","Data":"0708edaf6cb5efaa39f0e828583a0554fd4f62fce75873423445851bb6d2b7fe"}
Nov 03 17:30:01.456837 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.456795    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg" event={"ID":"dabcf1df-5d48-4e4b-8491-288ad2dfd279","Type":"ContainerStarted","Data":"8893c552e4a7fdaf070b1bdac780484170097187a21137087f958fa48815e902"}
Nov 03 17:30:01.456837 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.456829    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"
Nov 03 17:30:01.458347 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.458317    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh" event={"ID":"cd9016e5-9676-4809-a81d-8f8aa1d08c8b","Type":"ContainerStarted","Data":"22177679063c25d73cade5f78b73397cb964a120f5936f656fd1d06055a8d55e"}
Nov 03 17:30:01.458496 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.458359    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh" event={"ID":"cd9016e5-9676-4809-a81d-8f8aa1d08c8b","Type":"ContainerStarted","Data":"d7a1a15d3ee123b47ebf076018d833a7cefef1c8eba47fa3e9a9ad79d44886cd"}
Nov 03 17:30:01.458496 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.458396    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"
Nov 03 17:30:01.577999 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.577949    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg" podStartSLOduration=1.577935973 podStartE2EDuration="1.577935973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:30:01.576712018 +0000 UTC m=+801.778050069" watchObservedRunningTime="2026-11-03 17:30:01.577935973 +0000 UTC m=+801.779274049"
Nov 03 17:30:01.697674 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.697616    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh" podStartSLOduration=1.697601402 podStartE2EDuration="1.697601402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:30:01.696494264 +0000 UTC m=+801.897832317" watchObservedRunningTime="2026-11-03 17:30:01.697601402 +0000 UTC m=+801.898939448"
Nov 03 17:30:01.869800 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.869764    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"]
Nov 03 17:30:01.873744 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.873718    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:30:01.940623 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.940560    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w4-147834-serving-cert\""
Nov 03 17:30:01.943352 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.943324    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"]
Nov 03 17:30:01.994967 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.994932    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71b69226-4c13-47d5-b488-d57be1f9615c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4\" (UID: \"71b69226-4c13-47d5-b488-d57be1f9615c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:30:01.995157 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.994977    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkwhn\" (UniqueName: \"kubernetes.io/projected/71b69226-4c13-47d5-b488-d57be1f9615c-kube-api-access-rkwhn\") pod \"maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4\" (UID: \"71b69226-4c13-47d5-b488-d57be1f9615c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:30:01.995157 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.995118    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71b69226-4c13-47d5-b488-d57be1f9615c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4\" (UID: \"71b69226-4c13-47d5-b488-d57be1f9615c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:30:01.995247 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:01.995158    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71b69226-4c13-47d5-b488-d57be1f9615c-metrics-certs\") pod \"maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4\" (UID: \"71b69226-4c13-47d5-b488-d57be1f9615c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:30:02.096235 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:02.096185    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71b69226-4c13-47d5-b488-d57be1f9615c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4\" (UID: \"71b69226-4c13-47d5-b488-d57be1f9615c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:30:02.096421 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:02.096247    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71b69226-4c13-47d5-b488-d57be1f9615c-metrics-certs\") pod \"maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4\" (UID: \"71b69226-4c13-47d5-b488-d57be1f9615c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:30:02.096421 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:02.096329    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71b69226-4c13-47d5-b488-d57be1f9615c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4\" (UID: \"71b69226-4c13-47d5-b488-d57be1f9615c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:30:02.096421 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:02.096359    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkwhn\" (UniqueName: \"kubernetes.io/projected/71b69226-4c13-47d5-b488-d57be1f9615c-kube-api-access-rkwhn\") pod \"maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4\" (UID: \"71b69226-4c13-47d5-b488-d57be1f9615c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:30:02.096600 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:30:02.096491    5021 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-serving-cert: secret "maas-api-e2e-shared-b-w4-147834-serving-cert" not found
Nov 03 17:30:02.096600 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:30:02.096551    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71b69226-4c13-47d5-b488-d57be1f9615c-maas-api-tls podName:71b69226-4c13-47d5-b488-d57be1f9615c nodeName:}" failed. No retries permitted until 2026-11-03 17:30:02.596532142 +0000 UTC m=+802.797870187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/71b69226-4c13-47d5-b488-d57be1f9615c-maas-api-tls") pod "maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4" (UID: "71b69226-4c13-47d5-b488-d57be1f9615c") : secret "maas-api-e2e-shared-b-w4-147834-serving-cert" not found
Nov 03 17:30:02.096924 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:02.096900    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71b69226-4c13-47d5-b488-d57be1f9615c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4\" (UID: \"71b69226-4c13-47d5-b488-d57be1f9615c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:30:02.098905 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:02.098873    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71b69226-4c13-47d5-b488-d57be1f9615c-metrics-certs\") pod \"maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4\" (UID: \"71b69226-4c13-47d5-b488-d57be1f9615c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:30:02.162364 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:02.162292    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkwhn\" (UniqueName: \"kubernetes.io/projected/71b69226-4c13-47d5-b488-d57be1f9615c-kube-api-access-rkwhn\") pod \"maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4\" (UID: \"71b69226-4c13-47d5-b488-d57be1f9615c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:30:02.602711 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:02.602670    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71b69226-4c13-47d5-b488-d57be1f9615c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4\" (UID: \"71b69226-4c13-47d5-b488-d57be1f9615c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:30:02.605093 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:02.605072    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71b69226-4c13-47d5-b488-d57be1f9615c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4\" (UID: \"71b69226-4c13-47d5-b488-d57be1f9615c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:30:02.788491 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:02.788452    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:30:03.169479 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:03.169440    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"]
Nov 03 17:30:03.170550 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:30:03.170522    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71b69226_4c13_47d5_b488_d57be1f9615c.slice/crio-ec4deb5d14e19eafb60ea9bebd801653034d6b7e5b70e2f53f05226dd212f9b6 WatchSource:0}: Error finding container ec4deb5d14e19eafb60ea9bebd801653034d6b7e5b70e2f53f05226dd212f9b6: Status 404 returned error can't find the container with id ec4deb5d14e19eafb60ea9bebd801653034d6b7e5b70e2f53f05226dd212f9b6
Nov 03 17:30:03.483949 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:03.483866    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4" event={"ID":"71b69226-4c13-47d5-b488-d57be1f9615c","Type":"ContainerStarted","Data":"ec4deb5d14e19eafb60ea9bebd801653034d6b7e5b70e2f53f05226dd212f9b6"}
Nov 03 17:30:04.491960 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:04.491867    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4" event={"ID":"71b69226-4c13-47d5-b488-d57be1f9615c","Type":"ContainerStarted","Data":"655c0ab6a5eafbf0b061c99212bd2ed645e72ec8327023af0ded6b7f990fbeff"}
Nov 03 17:30:04.491960 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:04.491938    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:30:04.615903 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:04.615849    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4" podStartSLOduration=2.6754075029999997 podStartE2EDuration="3.615834834s" totalImagesPullingTime="940.427331ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:30:04.613955457 +0000 UTC m=+804.815293509" watchObservedRunningTime="2026-11-03 17:30:04.615834834 +0000 UTC m=+804.817172901"
Nov 03 17:30:07.046162 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:30:07.046125    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:30:10.502781 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:10.502755    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:30:12.480669 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:12.480642    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"
Nov 03 17:30:12.481034 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:12.480703    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"
Nov 03 17:30:25.097821 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.097783    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"]
Nov 03 17:30:25.102101 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.102080    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.153596 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.153560    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtg7l\" (UniqueName: \"kubernetes.io/projected/a2de9f7c-8a08-4b83-af23-04ef58ff5739-kube-api-access-jtg7l\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.153768 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.153606    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-credential-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.153768 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.153631    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-envoy\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.153768 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.153701    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-podinfo\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.153906 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.153807    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istiod-ca-cert\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.153906 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.153829    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-data\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.153906 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.153857    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-workload-certs\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.154003 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.153964    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-token\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.154003 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.153995    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-workload-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.157471 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.157446    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-687fb3-openshift-default-dockercfg-r5dqj\""
Nov 03 17:30:25.214311 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.214272    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"]
Nov 03 17:30:25.254706 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.254665    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-envoy\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.254928 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.254713    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-podinfo\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.254928 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.254770    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istiod-ca-cert\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.254928 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.254802    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-data\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.254928 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.254842    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-workload-certs\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.254928 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.254906    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-token\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.255214 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.254946    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-workload-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.255214 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.255044    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtg7l\" (UniqueName: \"kubernetes.io/projected/a2de9f7c-8a08-4b83-af23-04ef58ff5739-kube-api-access-jtg7l\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.255214 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.255083    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-credential-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.257784 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.257755    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-data\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.258240 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.258197    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-workload-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.258428 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.258406    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-credential-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.258601 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.258575    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-workload-certs\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.259010 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.258984    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istiod-ca-cert\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.259774 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.259749    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-envoy\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.260753 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.260724    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-podinfo\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.318390 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.318356    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-token\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.321193 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.321167    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtg7l\" (UniqueName: \"kubernetes.io/projected/a2de9f7c-8a08-4b83-af23-04ef58ff5739-kube-api-access-jtg7l\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.416132 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.416054    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:25.852498 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.852468    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"]
Nov 03 17:30:25.853295 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:30:25.853270    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2de9f7c_8a08_4b83_af23_04ef58ff5739.slice/crio-c6b56188594901fc3de429f2d9b9fa1413f15f73d0f6df94c56e9d7ece0c7e1b WatchSource:0}: Error finding container c6b56188594901fc3de429f2d9b9fa1413f15f73d0f6df94c56e9d7ece0c7e1b: Status 404 returned error can't find the container with id c6b56188594901fc3de429f2d9b9fa1413f15f73d0f6df94c56e9d7ece0c7e1b
Nov 03 17:30:25.855692 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.855660    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:30:25.855768 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.855726    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:30:25.855768 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:25.855756    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:30:26.655663 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:26.655627    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s" event={"ID":"a2de9f7c-8a08-4b83-af23-04ef58ff5739","Type":"ContainerStarted","Data":"f87eb028d9be4ac4323e6f079b1b479231d31efa272da295171d39ab87b17d24"}
Nov 03 17:30:26.656076 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:26.655694    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s" event={"ID":"a2de9f7c-8a08-4b83-af23-04ef58ff5739","Type":"ContainerStarted","Data":"c6b56188594901fc3de429f2d9b9fa1413f15f73d0f6df94c56e9d7ece0c7e1b"}
Nov 03 17:30:26.850618 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:26.850550    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s" podStartSLOduration=1.850531801 podStartE2EDuration="1.850531801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:30:26.84474204 +0000 UTC m=+827.046080107" watchObservedRunningTime="2026-11-03 17:30:26.850531801 +0000 UTC m=+827.051869854"
Nov 03 17:30:27.417156 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:27.417115    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:27.418397 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:27.418376    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 03 17:30:27.418464 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:27.418427    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s" podUID="a2de9f7c-8a08-4b83-af23-04ef58ff5739" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 03 17:30:28.417498 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:28.417452    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 03 17:30:28.417903 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:28.417524    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s" podUID="a2de9f7c-8a08-4b83-af23-04ef58ff5739" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 03 17:30:29.416809 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:29.416768    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 03 17:30:29.416970 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:29.416827    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s" podUID="a2de9f7c-8a08-4b83-af23-04ef58ff5739" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 03 17:30:29.765454 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:29.765414    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"]
Nov 03 17:30:29.770717 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:29.770691    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:30:29.821773 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:29.821728    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b5d5fee-ac09-47ae-96de-64fefcf56c42-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv\" (UID: \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:30:29.821955 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:29.821793    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5d5fee-ac09-47ae-96de-64fefcf56c42-metrics-certs\") pod \"maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv\" (UID: \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:30:29.821955 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:29.821824    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkbl9\" (UniqueName: \"kubernetes.io/projected/3b5d5fee-ac09-47ae-96de-64fefcf56c42-kube-api-access-nkbl9\") pod \"maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv\" (UID: \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:30:29.821955 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:29.821940    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b5d5fee-ac09-47ae-96de-64fefcf56c42-maas-api-tls\") pod \"maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv\" (UID: \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:30:29.869248 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:29.833829    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"]
Nov 03 17:30:29.889249 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:29.879131    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-3f1cf1-serving-cert\""
Nov 03 17:30:29.923067 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:29.923032    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b5d5fee-ac09-47ae-96de-64fefcf56c42-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv\" (UID: \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:30:29.923067 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:29.923077    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5d5fee-ac09-47ae-96de-64fefcf56c42-metrics-certs\") pod \"maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv\" (UID: \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:30:29.923311 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:29.923098    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkbl9\" (UniqueName: \"kubernetes.io/projected/3b5d5fee-ac09-47ae-96de-64fefcf56c42-kube-api-access-nkbl9\") pod \"maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv\" (UID: \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:30:29.923311 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:29.923182    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b5d5fee-ac09-47ae-96de-64fefcf56c42-maas-api-tls\") pod \"maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv\" (UID: \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:30:29.923732 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:30:29.923405    5021 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-serving-cert: secret "maas-api-e2e-inf-a-3f1cf1-serving-cert" not found
Nov 03 17:30:29.923732 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:30:29.923472    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b5d5fee-ac09-47ae-96de-64fefcf56c42-maas-api-tls podName:3b5d5fee-ac09-47ae-96de-64fefcf56c42 nodeName:}" failed. No retries permitted until 2026-11-03 17:30:30.423453896 +0000 UTC m=+830.624791925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3b5d5fee-ac09-47ae-96de-64fefcf56c42-maas-api-tls") pod "maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv" (UID: "3b5d5fee-ac09-47ae-96de-64fefcf56c42") : secret "maas-api-e2e-inf-a-3f1cf1-serving-cert" not found
Nov 03 17:30:29.924159 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:29.924137    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b5d5fee-ac09-47ae-96de-64fefcf56c42-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv\" (UID: \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:30:29.973913 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:29.973876    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5d5fee-ac09-47ae-96de-64fefcf56c42-metrics-certs\") pod \"maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv\" (UID: \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:30:29.989092 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:29.989026    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkbl9\" (UniqueName: \"kubernetes.io/projected/3b5d5fee-ac09-47ae-96de-64fefcf56c42-kube-api-access-nkbl9\") pod \"maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv\" (UID: \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:30:30.416839 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:30.416801    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 03 17:30:30.417019 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:30.416913    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s" podUID="a2de9f7c-8a08-4b83-af23-04ef58ff5739" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 03 17:30:30.451125 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:30.451066    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b5d5fee-ac09-47ae-96de-64fefcf56c42-maas-api-tls\") pod \"maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv\" (UID: \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:30:30.454786 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:30.454753    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b5d5fee-ac09-47ae-96de-64fefcf56c42-maas-api-tls\") pod \"maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv\" (UID: \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:30:30.690964 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:30.690880    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:30:31.097278 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:30:31.097247    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b5d5fee_ac09_47ae_96de_64fefcf56c42.slice/crio-bc2590e2df4b4f960b32ca9eeff5a2003840b0a0953ed272719f28cabc6d1bf0 WatchSource:0}: Error finding container bc2590e2df4b4f960b32ca9eeff5a2003840b0a0953ed272719f28cabc6d1bf0: Status 404 returned error can't find the container with id bc2590e2df4b4f960b32ca9eeff5a2003840b0a0953ed272719f28cabc6d1bf0
Nov 03 17:30:31.098124 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:31.098096    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"]
Nov 03 17:30:31.416509 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:31.416431    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 03 17:30:31.416509 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:31.416495    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s" podUID="a2de9f7c-8a08-4b83-af23-04ef58ff5739" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 03 17:30:31.700505 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:31.700428    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv" event={"ID":"3b5d5fee-ac09-47ae-96de-64fefcf56c42","Type":"ContainerStarted","Data":"bc2590e2df4b4f960b32ca9eeff5a2003840b0a0953ed272719f28cabc6d1bf0"}
Nov 03 17:30:32.416900 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:32.416866    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Nov 03 17:30:32.417321 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:32.416917    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s" podUID="a2de9f7c-8a08-4b83-af23-04ef58ff5739" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Nov 03 17:30:32.710144 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:32.710051    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv" event={"ID":"3b5d5fee-ac09-47ae-96de-64fefcf56c42","Type":"ContainerStarted","Data":"4889354a8f2debc54663ec79215a97c2c96a7387088c44ce5658b995b2f80b64"}
Nov 03 17:30:32.710302 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:32.710259    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:30:32.834989 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:32.834938    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv" podStartSLOduration=2.941189621 podStartE2EDuration="3.83492232s" totalImagesPullingTime="893.732699ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:30:32.833065686 +0000 UTC m=+833.034403740" watchObservedRunningTime="2026-11-03 17:30:32.83492232 +0000 UTC m=+833.036260406"
Nov 03 17:30:33.759859 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:33.759826    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:33.760393 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:33.760280    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:33.761124 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:33.761099    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:30:37.046414 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:30:37.046369    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:30:38.728142 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:30:38.728114    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:31:07.051553 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:31:07.050478    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:31:25.608933 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.608899    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"]
Nov 03 17:31:25.612886 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.612869    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.748426 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.748394    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"]
Nov 03 17:31:25.776925 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.776889    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-envoy\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.777111 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.776952    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-podinfo\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.777111 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.777060    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-workload-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.777236 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.777115    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-workload-certs\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.777236 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.777148    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istiod-ca-cert\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.777329 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.777313    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vl86\" (UniqueName: \"kubernetes.io/projected/31cf4b70-4b18-4711-aedd-31bf4c9a987f-kube-api-access-9vl86\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.777408 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.777391    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-data\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.777463 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.777448    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-token\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.777539 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.777520    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-credential-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.878718 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.878636    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-workload-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.878718 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.878681    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-workload-certs\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.878718 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.878698    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istiod-ca-cert\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.879012 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.878757    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vl86\" (UniqueName: \"kubernetes.io/projected/31cf4b70-4b18-4711-aedd-31bf4c9a987f-kube-api-access-9vl86\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.879012 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.878791    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-data\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.879012 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.878826    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-token\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.879012 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.878944    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-credential-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.879012 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.879005    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-envoy\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.879289 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.879049    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-podinfo\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.879289 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.879109    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-workload-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.879289 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.879145    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-workload-certs\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.879605 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.879581    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istiod-ca-cert\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.879759 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.879626    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-credential-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.879759 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.879684    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-data\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.881467 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.881442    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-envoy\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.881672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.881653    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-podinfo\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.942701 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.942669    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-token\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:25.942913 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:25.942889    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vl86\" (UniqueName: \"kubernetes.io/projected/31cf4b70-4b18-4711-aedd-31bf4c9a987f-kube-api-access-9vl86\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:26.226481 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:26.226378    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:26.662484 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:26.662452    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"]
Nov 03 17:31:26.663020 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:31:26.662995    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31cf4b70_4b18_4711_aedd_31bf4c9a987f.slice/crio-89d0abcfe94fe04a7b497a01bc676bc649345dfff03c3fcd2f5a7a282ffc16a4 WatchSource:0}: Error finding container 89d0abcfe94fe04a7b497a01bc676bc649345dfff03c3fcd2f5a7a282ffc16a4: Status 404 returned error can't find the container with id 89d0abcfe94fe04a7b497a01bc676bc649345dfff03c3fcd2f5a7a282ffc16a4
Nov 03 17:31:26.665338 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:26.665307    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:31:26.665414 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:26.665368    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:31:26.665414 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:26.665395    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:31:27.116739 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:27.116700    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w" event={"ID":"31cf4b70-4b18-4711-aedd-31bf4c9a987f","Type":"ContainerStarted","Data":"ce0064fff29383172740d61a4cbd681e2873b6addbf8c592e939e92795db9946"}
Nov 03 17:31:27.117505 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:27.117471    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w" event={"ID":"31cf4b70-4b18-4711-aedd-31bf4c9a987f","Type":"ContainerStarted","Data":"89d0abcfe94fe04a7b497a01bc676bc649345dfff03c3fcd2f5a7a282ffc16a4"}
Nov 03 17:31:27.247254 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:27.247197    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:27.247465 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:27.247350    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Nov 03 17:31:27.247465 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:27.247398    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w" podUID="31cf4b70-4b18-4711-aedd-31bf4c9a987f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Nov 03 17:31:27.294518 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:27.294464    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w" podStartSLOduration=2.294450415 podStartE2EDuration="2.294450415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:31:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:31:27.293924198 +0000 UTC m=+887.495262249" watchObservedRunningTime="2026-11-03 17:31:27.294450415 +0000 UTC m=+887.495788466"
Nov 03 17:31:28.243253 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:28.228656    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Nov 03 17:31:28.243253 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:28.228735    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w" podUID="31cf4b70-4b18-4711-aedd-31bf4c9a987f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Nov 03 17:31:29.245250 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:29.244667    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Nov 03 17:31:29.245250 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:29.244764    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w" podUID="31cf4b70-4b18-4711-aedd-31bf4c9a987f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Nov 03 17:31:30.240363 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:30.240323    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Nov 03 17:31:30.240681 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:30.240650    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w" podUID="31cf4b70-4b18-4711-aedd-31bf4c9a987f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Nov 03 17:31:31.230250 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:31.228652    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Nov 03 17:31:31.230250 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:31.228759    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w" podUID="31cf4b70-4b18-4711-aedd-31bf4c9a987f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Nov 03 17:31:32.248305 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:32.244569    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Nov 03 17:31:32.248305 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:32.244633    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w" podUID="31cf4b70-4b18-4711-aedd-31bf4c9a987f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Nov 03 17:31:32.285318 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:32.285282    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"]
Nov 03 17:31:32.382187 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:32.382150    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"]
Nov 03 17:31:33.227671 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:33.227623    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Nov 03 17:31:33.227895 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:33.227692    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w" podUID="31cf4b70-4b18-4711-aedd-31bf4c9a987f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Nov 03 17:31:34.231544 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:34.231513    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:34.231996 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:34.231830    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:34.232513 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:34.232490    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:31:37.045659 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:31:37.045624    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:31:37.285871 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:37.285830    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9" podUID="ae6b2e16-8755-4481-9b70-d66354dc00dc" containerName="payload-processing" containerID="cri-o://7462f51652b999b3ece221eb730eaedc1d62b015388e517b56bf9a1611a2205d" gracePeriod=25
Nov 03 17:31:37.383559 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:37.383457    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp" podUID="c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0" containerName="payload-pre-processing" containerID="cri-o://33d4c0f5156e19f523d9e3bbfa9cd616fedeecf5b07ff08373942388de61b879" gracePeriod=25
Nov 03 17:31:40.098268 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:40.098239    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:31:40.099590 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:40.099565    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:31:40.484510 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:40.484421    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp" podUID="c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:31:40.484669 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:40.484421    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9" podUID="ae6b2e16-8755-4481-9b70-d66354dc00dc" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:31:50.484542 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:50.484500    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp" podUID="c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:31:50.484955 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:50.484593    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9" podUID="ae6b2e16-8755-4481-9b70-d66354dc00dc" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:31:54.465743 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:54.465705    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"]
Nov 03 17:31:54.469635 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:54.469616    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:31:54.539871 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:54.539824    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlsrg\" (UniqueName: \"kubernetes.io/projected/ddf156de-58e2-4c01-a74b-b46896c6ab42-kube-api-access-hlsrg\") pod \"maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6\" (UID: \"ddf156de-58e2-4c01-a74b-b46896c6ab42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:31:54.540057 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:54.539884    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddf156de-58e2-4c01-a74b-b46896c6ab42-maas-api-tls\") pod \"maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6\" (UID: \"ddf156de-58e2-4c01-a74b-b46896c6ab42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:31:54.540057 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:54.540037    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddf156de-58e2-4c01-a74b-b46896c6ab42-metrics-certs\") pod \"maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6\" (UID: \"ddf156de-58e2-4c01-a74b-b46896c6ab42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:31:54.540201 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:54.540090    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddf156de-58e2-4c01-a74b-b46896c6ab42-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6\" (UID: \"ddf156de-58e2-4c01-a74b-b46896c6ab42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:31:54.576509 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:54.576476    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-e34dd2-serving-cert\""
Nov 03 17:31:54.582298 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:54.582260    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"]
Nov 03 17:31:54.641822 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:54.641772    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddf156de-58e2-4c01-a74b-b46896c6ab42-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6\" (UID: \"ddf156de-58e2-4c01-a74b-b46896c6ab42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:31:54.642032 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:54.641974    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlsrg\" (UniqueName: \"kubernetes.io/projected/ddf156de-58e2-4c01-a74b-b46896c6ab42-kube-api-access-hlsrg\") pod \"maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6\" (UID: \"ddf156de-58e2-4c01-a74b-b46896c6ab42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:31:54.642032 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:54.642009    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddf156de-58e2-4c01-a74b-b46896c6ab42-maas-api-tls\") pod \"maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6\" (UID: \"ddf156de-58e2-4c01-a74b-b46896c6ab42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:31:54.642169 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:54.642085    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddf156de-58e2-4c01-a74b-b46896c6ab42-metrics-certs\") pod \"maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6\" (UID: \"ddf156de-58e2-4c01-a74b-b46896c6ab42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:31:54.643857 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:54.643792    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddf156de-58e2-4c01-a74b-b46896c6ab42-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6\" (UID: \"ddf156de-58e2-4c01-a74b-b46896c6ab42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:31:54.644071 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:31:54.644054    5021 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-serving-cert: secret "maas-api-e2e-inf-b-e34dd2-serving-cert" not found
Nov 03 17:31:54.644415 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:31:54.644391    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddf156de-58e2-4c01-a74b-b46896c6ab42-maas-api-tls podName:ddf156de-58e2-4c01-a74b-b46896c6ab42 nodeName:}" failed. No retries permitted until 2026-11-03 17:31:55.144206831 +0000 UTC m=+915.345544878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ddf156de-58e2-4c01-a74b-b46896c6ab42-maas-api-tls") pod "maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6" (UID: "ddf156de-58e2-4c01-a74b-b46896c6ab42") : secret "maas-api-e2e-inf-b-e34dd2-serving-cert" not found
Nov 03 17:31:54.649342 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:54.649314    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddf156de-58e2-4c01-a74b-b46896c6ab42-metrics-certs\") pod \"maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6\" (UID: \"ddf156de-58e2-4c01-a74b-b46896c6ab42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:31:54.709775 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:54.709742    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlsrg\" (UniqueName: \"kubernetes.io/projected/ddf156de-58e2-4c01-a74b-b46896c6ab42-kube-api-access-hlsrg\") pod \"maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6\" (UID: \"ddf156de-58e2-4c01-a74b-b46896c6ab42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:31:55.148407 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.148292    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddf156de-58e2-4c01-a74b-b46896c6ab42-maas-api-tls\") pod \"maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6\" (UID: \"ddf156de-58e2-4c01-a74b-b46896c6ab42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:31:55.168087 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.168000    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddf156de-58e2-4c01-a74b-b46896c6ab42-maas-api-tls\") pod \"maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6\" (UID: \"ddf156de-58e2-4c01-a74b-b46896c6ab42\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:31:55.388417 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.388380    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:31:55.487305 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.487269    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"]
Nov 03 17:31:55.491761 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.491736    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.557827 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.557794    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tnqx\" (UniqueName: \"kubernetes.io/projected/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-kube-api-access-2tnqx\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.557973 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.557842    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-token\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.557973 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.557916    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istiod-ca-cert\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.558068 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.557975    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-workload-certs\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.558068 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.558009    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-data\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.558129 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.558067    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-workload-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.558165 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.558132    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-podinfo\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.558200 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.558162    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-envoy\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.558269 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.558197    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-credential-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.568905 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.568872    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"]
Nov 03 17:31:55.659289 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.659204    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-token\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.659289 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.659274    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istiod-ca-cert\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.659532 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.659297    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-workload-certs\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.659532 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.659313    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-data\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.659532 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.659330    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-workload-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.659532 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.659384    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-podinfo\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.659532 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.659418    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-envoy\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.659532 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.659473    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-credential-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.659841 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.659557    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tnqx\" (UniqueName: \"kubernetes.io/projected/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-kube-api-access-2tnqx\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.659841 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.659693    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-data\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.659841 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.659758    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-workload-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.659841 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.659792    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-workload-certs\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.660072 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.659875    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-credential-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.660401 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.660378    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istiod-ca-cert\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.661708 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.661676    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-envoy\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.661973 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.661955    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-podinfo\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.724059 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.724024    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-token\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.724209 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.724139    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tnqx\" (UniqueName: \"kubernetes.io/projected/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-kube-api-access-2tnqx\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:55.775557 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.775517    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"]
Nov 03 17:31:55.775678 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:31:55.775588    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddf156de_58e2_4c01_a74b_b46896c6ab42.slice/crio-28e8096f0c5835f34ae8ebe8714024fa67a092fa08b585ffdf0355abd6588546 WatchSource:0}: Error finding container 28e8096f0c5835f34ae8ebe8714024fa67a092fa08b585ffdf0355abd6588546: Status 404 returned error can't find the container with id 28e8096f0c5835f34ae8ebe8714024fa67a092fa08b585ffdf0355abd6588546
Nov 03 17:31:55.810051 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:55.810031    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:56.242007 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:31:56.241962    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f2cfcf_bea5_4a8f_b78e_70779445cee7.slice/crio-a3bfe84b8c7440eb46cd427652f7b805632cce179dce099b1503334da1bddc24 WatchSource:0}: Error finding container a3bfe84b8c7440eb46cd427652f7b805632cce179dce099b1503334da1bddc24: Status 404 returned error can't find the container with id a3bfe84b8c7440eb46cd427652f7b805632cce179dce099b1503334da1bddc24
Nov 03 17:31:56.242155 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:56.242131    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"]
Nov 03 17:31:56.244733 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:56.244700    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:31:56.244817 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:56.244764    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:31:56.244817 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:56.244793    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:31:56.323164 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:56.323136    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6" event={"ID":"ddf156de-58e2-4c01-a74b-b46896c6ab42","Type":"ContainerStarted","Data":"28e8096f0c5835f34ae8ebe8714024fa67a092fa08b585ffdf0355abd6588546"}
Nov 03 17:31:56.324895 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:56.324860    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z" event={"ID":"f8f2cfcf-bea5-4a8f-b78e-70779445cee7","Type":"ContainerStarted","Data":"b43ec9bf253bb6af7f242823a1b535491e0adeacafd7c4d9ed4c6231b83541df"}
Nov 03 17:31:56.324987 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:56.324914    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z" event={"ID":"f8f2cfcf-bea5-4a8f-b78e-70779445cee7","Type":"ContainerStarted","Data":"a3bfe84b8c7440eb46cd427652f7b805632cce179dce099b1503334da1bddc24"}
Nov 03 17:31:56.455449 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:56.455399    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z" podStartSLOduration=1.45538556 podStartE2EDuration="1.45538556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:31:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:31:56.452743893 +0000 UTC m=+916.654081946" watchObservedRunningTime="2026-11-03 17:31:56.45538556 +0000 UTC m=+916.656723693"
Nov 03 17:31:56.810652 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:56.810619    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:31:57.342249 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.340018    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6" event={"ID":"ddf156de-58e2-4c01-a74b-b46896c6ab42","Type":"ContainerStarted","Data":"a566d30ac96b20ef02795f96a3f3fc88d23b1f2c54539a586bb974341449c009"}
Nov 03 17:31:57.342249 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.340112    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:31:57.463116 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.463055    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6" podStartSLOduration=2.583761955 podStartE2EDuration="3.463035948s" totalImagesPullingTime="879.273993ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:31:57.461513939 +0000 UTC m=+917.662851990" watchObservedRunningTime="2026-11-03 17:31:57.463035948 +0000 UTC m=+917.664374001"
Nov 03 17:31:57.666302 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.666269    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"
Nov 03 17:31:57.681676 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.681638    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae6b2e16-8755-4481-9b70-d66354dc00dc-kube-api-access-n5rlv\" (UniqueName: \"kubernetes.io/projected/ae6b2e16-8755-4481-9b70-d66354dc00dc-kube-api-access-n5rlv\") pod \"ae6b2e16-8755-4481-9b70-d66354dc00dc\" (UID: \"ae6b2e16-8755-4481-9b70-d66354dc00dc\") "
Nov 03 17:31:57.681891 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.681871    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae6b2e16-8755-4481-9b70-d66354dc00dc-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae6b2e16-8755-4481-9b70-d66354dc00dc-plugins-config-volume\") pod \"ae6b2e16-8755-4481-9b70-d66354dc00dc\" (UID: \"ae6b2e16-8755-4481-9b70-d66354dc00dc\") "
Nov 03 17:31:57.682972 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.682941    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae6b2e16-8755-4481-9b70-d66354dc00dc-plugins-config-volume" pod "ae6b2e16-8755-4481-9b70-d66354dc00dc" (UID: "ae6b2e16-8755-4481-9b70-d66354dc00dc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:31:57.685702 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.685672    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae6b2e16-8755-4481-9b70-d66354dc00dc-kube-api-access-n5rlv" pod "ae6b2e16-8755-4481-9b70-d66354dc00dc" (UID: "ae6b2e16-8755-4481-9b70-d66354dc00dc"). InnerVolumeSpecName "kube-api-access-n5rlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:31:57.780474 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.780449    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"
Nov 03 17:31:57.783830 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.783802    5021 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae6b2e16-8755-4481-9b70-d66354dc00dc-plugins-config-volume\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:31:57.783830 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.783829    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5rlv\" (UniqueName: \"kubernetes.io/projected/ae6b2e16-8755-4481-9b70-d66354dc00dc-kube-api-access-n5rlv\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:31:57.811857 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.811822    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Nov 03 17:31:57.812280 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.811883    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z" podUID="f8f2cfcf-bea5-4a8f-b78e-70779445cee7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Nov 03 17:31:57.884347 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.884263    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0-kube-api-access-hqct4\" (UniqueName: \"kubernetes.io/projected/c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0-kube-api-access-hqct4\") pod \"c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0\" (UID: \"c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0\") "
Nov 03 17:31:57.884516 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.884380    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0-plugins-config-volume\") pod \"c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0\" (UID: \"c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0\") "
Nov 03 17:31:57.884772 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.884745    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0-plugins-config-volume" pod "c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0" (UID: "c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:31:57.886563 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.886537    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0-kube-api-access-hqct4" pod "c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0" (UID: "c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0"). InnerVolumeSpecName "kube-api-access-hqct4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:31:57.986132 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.986097    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqct4\" (UniqueName: \"kubernetes.io/projected/c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0-kube-api-access-hqct4\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:31:57.986132 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:57.986128    5021 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0-plugins-config-volume\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:31:58.356600 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.356560    5021 generic.go:356] "Generic (PLEG): container finished" podID="ae6b2e16-8755-4481-9b70-d66354dc00dc" containerID="7462f51652b999b3ece221eb730eaedc1d62b015388e517b56bf9a1611a2205d" exitCode=0
Nov 03 17:31:58.356808 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.356608    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"
Nov 03 17:31:58.356808 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.356646    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9" event={"ID":"ae6b2e16-8755-4481-9b70-d66354dc00dc","Type":"ContainerDied","Data":"7462f51652b999b3ece221eb730eaedc1d62b015388e517b56bf9a1611a2205d"}
Nov 03 17:31:58.356808 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.356701    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9" event={"ID":"ae6b2e16-8755-4481-9b70-d66354dc00dc","Type":"ContainerDied","Data":"7b8414fb96cc76e84a3bace2edafdee66f21ad4d17a376689316d90d7a078d2f"}
Nov 03 17:31:58.356808 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.356730    5021 scope.go:122] "RemoveContainer" containerID="7462f51652b999b3ece221eb730eaedc1d62b015388e517b56bf9a1611a2205d"
Nov 03 17:31:58.358033 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.358014    5021 generic.go:356] "Generic (PLEG): container finished" podID="c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0" containerID="33d4c0f5156e19f523d9e3bbfa9cd616fedeecf5b07ff08373942388de61b879" exitCode=0
Nov 03 17:31:58.358141 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.358044    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp" event={"ID":"c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0","Type":"ContainerDied","Data":"33d4c0f5156e19f523d9e3bbfa9cd616fedeecf5b07ff08373942388de61b879"}
Nov 03 17:31:58.358141 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.358075    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"
Nov 03 17:31:58.358141 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.358092    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp" event={"ID":"c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0","Type":"ContainerDied","Data":"76e50b6701eddddb1c1b636e022b17cd2f59d1d85ea73bcea231c9b59b8bdb6f"}
Nov 03 17:31:58.367411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.367393    5021 scope.go:122] "RemoveContainer" containerID="7462f51652b999b3ece221eb730eaedc1d62b015388e517b56bf9a1611a2205d"
Nov 03 17:31:58.367654 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:31:58.367636    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7462f51652b999b3ece221eb730eaedc1d62b015388e517b56bf9a1611a2205d\": container with ID starting with 7462f51652b999b3ece221eb730eaedc1d62b015388e517b56bf9a1611a2205d not found: ID does not exist" containerID="7462f51652b999b3ece221eb730eaedc1d62b015388e517b56bf9a1611a2205d"
Nov 03 17:31:58.367713 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.367662    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7462f51652b999b3ece221eb730eaedc1d62b015388e517b56bf9a1611a2205d"} err="failed to get container status \"7462f51652b999b3ece221eb730eaedc1d62b015388e517b56bf9a1611a2205d\": rpc error: code = NotFound desc = could not find container \"7462f51652b999b3ece221eb730eaedc1d62b015388e517b56bf9a1611a2205d\": container with ID starting with 7462f51652b999b3ece221eb730eaedc1d62b015388e517b56bf9a1611a2205d not found: ID does not exist"
Nov 03 17:31:58.367713 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.367680    5021 scope.go:122] "RemoveContainer" containerID="33d4c0f5156e19f523d9e3bbfa9cd616fedeecf5b07ff08373942388de61b879"
Nov 03 17:31:58.376419 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.376399    5021 scope.go:122] "RemoveContainer" containerID="33d4c0f5156e19f523d9e3bbfa9cd616fedeecf5b07ff08373942388de61b879"
Nov 03 17:31:58.376682 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:31:58.376660    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33d4c0f5156e19f523d9e3bbfa9cd616fedeecf5b07ff08373942388de61b879\": container with ID starting with 33d4c0f5156e19f523d9e3bbfa9cd616fedeecf5b07ff08373942388de61b879 not found: ID does not exist" containerID="33d4c0f5156e19f523d9e3bbfa9cd616fedeecf5b07ff08373942388de61b879"
Nov 03 17:31:58.376747 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.376689    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33d4c0f5156e19f523d9e3bbfa9cd616fedeecf5b07ff08373942388de61b879"} err="failed to get container status \"33d4c0f5156e19f523d9e3bbfa9cd616fedeecf5b07ff08373942388de61b879\": rpc error: code = NotFound desc = could not find container \"33d4c0f5156e19f523d9e3bbfa9cd616fedeecf5b07ff08373942388de61b879\": container with ID starting with 33d4c0f5156e19f523d9e3bbfa9cd616fedeecf5b07ff08373942388de61b879 not found: ID does not exist"
Nov 03 17:31:58.552484 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.552448    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"]
Nov 03 17:31:58.555950 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.555916    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-praxis-a-8fc5ec-ccbcbb6ff-2ntl9"]
Nov 03 17:31:58.664681 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.664595    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"]
Nov 03 17:31:58.670768 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.670738    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-praxis-a-8fc5ec-669df88c8c-76fjp"]
Nov 03 17:31:58.810851 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.810814    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Nov 03 17:31:58.811024 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:58.810870    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z" podUID="f8f2cfcf-bea5-4a8f-b78e-70779445cee7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Nov 03 17:31:59.810522 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:59.810484    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Nov 03 17:31:59.811003 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:31:59.810549    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z" podUID="f8f2cfcf-bea5-4a8f-b78e-70779445cee7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Nov 03 17:32:00.003132 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:00.003093    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ae6b2e16-8755-4481-9b70-d66354dc00dc" path="/var/lib/kubelet/pods/ae6b2e16-8755-4481-9b70-d66354dc00dc/volumes"
Nov 03 17:32:00.003623 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:00.003601    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0" path="/var/lib/kubelet/pods/c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0/volumes"
Nov 03 17:32:00.811297 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:00.811264    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Nov 03 17:32:00.811687 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:00.811325    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z" podUID="f8f2cfcf-bea5-4a8f-b78e-70779445cee7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Nov 03 17:32:01.811244 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:01.811190    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Nov 03 17:32:01.811421 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:01.811260    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z" podUID="f8f2cfcf-bea5-4a8f-b78e-70779445cee7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Nov 03 17:32:02.810801 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:02.810765    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Nov 03 17:32:02.810972 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:02.810815    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z" podUID="f8f2cfcf-bea5-4a8f-b78e-70779445cee7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Nov 03 17:32:04.233487 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:04.233445    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:32:04.234188 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:04.234164    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:32:04.234944 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:04.234920    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:32:04.371707 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:04.371677    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:32:07.046537 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:32:07.046503    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:32:10.954492 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:10.954446    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"]
Nov 03 17:32:10.955099 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:10.955082    5021 cpu_manager.go:414] "containerMap: removing container" podUID="c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0" containerName="payload-pre-processing"
Nov 03 17:32:10.955099 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:10.955098    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0" containerName="payload-pre-processing"
Nov 03 17:32:10.955218 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:10.955108    5021 cpu_manager.go:414] "containerMap: removing container" podUID="ae6b2e16-8755-4481-9b70-d66354dc00dc" containerName="payload-processing"
Nov 03 17:32:10.955218 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:10.955113    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae6b2e16-8755-4481-9b70-d66354dc00dc" containerName="payload-processing"
Nov 03 17:32:10.955336 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:10.955221    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5f631d5-ef04-4e49-ba0f-bb1e8c76f6c0" containerName="payload-pre-processing"
Nov 03 17:32:10.955336 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:10.955247    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae6b2e16-8755-4481-9b70-d66354dc00dc" containerName="payload-processing"
Nov 03 17:32:10.960339 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:10.960314    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.055099 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.055061    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"]
Nov 03 17:32:11.057052 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.057012    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-workload-certs\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.057544 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.057516    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-istio-envoy\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.057727 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.057707    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-credential-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.057891 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.057874    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-istio-data\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.058016 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.058000    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1533139a-853a-4ca5-9c43-494ae9b29681-istiod-ca-cert\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.058155 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.058139    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpmrm\" (UniqueName: \"kubernetes.io/projected/1533139a-853a-4ca5-9c43-494ae9b29681-kube-api-access-xpmrm\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.058294 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.058278    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1533139a-853a-4ca5-9c43-494ae9b29681-istio-podinfo\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.058517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.058428    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-workload-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.058728 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.058702    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1533139a-853a-4ca5-9c43-494ae9b29681-istio-token\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.159523 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.159476    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-istio-envoy\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.159724 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.159554    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-credential-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.159724 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.159589    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-istio-data\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.159724 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.159623    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1533139a-853a-4ca5-9c43-494ae9b29681-istiod-ca-cert\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.159724 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.159672    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpmrm\" (UniqueName: \"kubernetes.io/projected/1533139a-853a-4ca5-9c43-494ae9b29681-kube-api-access-xpmrm\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.159724 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.159701    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1533139a-853a-4ca5-9c43-494ae9b29681-istio-podinfo\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.159978 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.159751    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-workload-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.159978 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.159840    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1533139a-853a-4ca5-9c43-494ae9b29681-istio-token\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.159978 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.159883    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-workload-certs\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.160138 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.160066    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-istio-data\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.160138 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.160101    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-credential-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.160401 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.160380    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-workload-certs\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.160603 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.160586    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-workload-socket\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.160652 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.160611    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1533139a-853a-4ca5-9c43-494ae9b29681-istiod-ca-cert\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.162771 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.162742    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-istio-envoy\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.162854 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.162745    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1533139a-853a-4ca5-9c43-494ae9b29681-istio-podinfo\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.223677 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.223585    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1533139a-853a-4ca5-9c43-494ae9b29681-istio-token\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.223849 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.223697    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpmrm\" (UniqueName: \"kubernetes.io/projected/1533139a-853a-4ca5-9c43-494ae9b29681-kube-api-access-xpmrm\") pod \"e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") " pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.275712 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.275676    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:11.715402 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.715367    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"]
Nov 03 17:32:11.716811 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:32:11.716648    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1533139a_853a_4ca5_9c43_494ae9b29681.slice/crio-8d73e5f6eafc0be834f466645eacc62cde9a210f7a7576776924da561044e2de WatchSource:0}: Error finding container 8d73e5f6eafc0be834f466645eacc62cde9a210f7a7576776924da561044e2de: Status 404 returned error can't find the container with id 8d73e5f6eafc0be834f466645eacc62cde9a210f7a7576776924da561044e2de
Nov 03 17:32:11.720540 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.720506    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:32:11.720657 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.720576    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:32:11.720657 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:11.720610    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:32:12.475340 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:12.475297    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj" event={"ID":"1533139a-853a-4ca5-9c43-494ae9b29681","Type":"ContainerStarted","Data":"b6861d99d43a480c2a062ae5ed3605d0aad1e400c01131a89580aade54791e61"}
Nov 03 17:32:12.475880 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:12.475367    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj" event={"ID":"1533139a-853a-4ca5-9c43-494ae9b29681","Type":"ContainerStarted","Data":"8d73e5f6eafc0be834f466645eacc62cde9a210f7a7576776924da561044e2de"}
Nov 03 17:32:12.659113 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:12.659054    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj" podStartSLOduration=2.65904159 podStartE2EDuration="2.65904159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:32:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:32:12.652701614 +0000 UTC m=+932.854039703" watchObservedRunningTime="2026-11-03 17:32:12.65904159 +0000 UTC m=+932.860379642"
Nov 03 17:32:13.276661 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:13.276626    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:13.277852 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:13.277829    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 03 17:32:13.277958 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:13.277884    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj" podUID="1533139a-853a-4ca5-9c43-494ae9b29681" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 03 17:32:14.276849 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:14.276813    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 03 17:32:14.277283 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:14.276870    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj" podUID="1533139a-853a-4ca5-9c43-494ae9b29681" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 03 17:32:15.276699 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:15.276665    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 03 17:32:15.276880 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:15.276721    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj" podUID="1533139a-853a-4ca5-9c43-494ae9b29681" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 03 17:32:16.276563 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:16.276528    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 03 17:32:16.276761 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:16.276600    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj" podUID="1533139a-853a-4ca5-9c43-494ae9b29681" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 03 17:32:17.277000 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:17.276963    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 03 17:32:17.277381 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:17.277027    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj" podUID="1533139a-853a-4ca5-9c43-494ae9b29681" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 03 17:32:18.276388 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:18.276354    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Nov 03 17:32:18.276594 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:18.276414    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj" podUID="1533139a-853a-4ca5-9c43-494ae9b29681" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Nov 03 17:32:19.281392 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:19.281356    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:19.281864 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:19.281836    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:19.282589 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:32:19.282572    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:32:37.058715 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:32:37.058674    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:33:06.255126 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.255088    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"]
Nov 03 17:33:06.255721 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.255349    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9" podUID="4371accb-31eb-4f49-a6e2-4a7550d33f15" containerName="maas-api" containerID="cri-o://0a62e052f501832dd2f0e0bb66ecb3f850682d639a262e10e3cfb4dbb1c21ab2" gracePeriod=30
Nov 03 17:33:06.526546 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.526481    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:33:06.634701 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.634659    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4371accb-31eb-4f49-a6e2-4a7550d33f15-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4371accb-31eb-4f49-a6e2-4a7550d33f15-metrics-certs\") pod \"4371accb-31eb-4f49-a6e2-4a7550d33f15\" (UID: \"4371accb-31eb-4f49-a6e2-4a7550d33f15\") "
Nov 03 17:33:06.634912 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.634730    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4371accb-31eb-4f49-a6e2-4a7550d33f15-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4371accb-31eb-4f49-a6e2-4a7550d33f15-maas-api-tls\") pod \"4371accb-31eb-4f49-a6e2-4a7550d33f15\" (UID: \"4371accb-31eb-4f49-a6e2-4a7550d33f15\") "
Nov 03 17:33:06.634912 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.634784    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4371accb-31eb-4f49-a6e2-4a7550d33f15-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4371accb-31eb-4f49-a6e2-4a7550d33f15-openshift-service-ca\") pod \"4371accb-31eb-4f49-a6e2-4a7550d33f15\" (UID: \"4371accb-31eb-4f49-a6e2-4a7550d33f15\") "
Nov 03 17:33:06.634912 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.634816    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4371accb-31eb-4f49-a6e2-4a7550d33f15-kube-api-access-b8xj8\" (UniqueName: \"kubernetes.io/projected/4371accb-31eb-4f49-a6e2-4a7550d33f15-kube-api-access-b8xj8\") pod \"4371accb-31eb-4f49-a6e2-4a7550d33f15\" (UID: \"4371accb-31eb-4f49-a6e2-4a7550d33f15\") "
Nov 03 17:33:06.635786 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.635749    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4371accb-31eb-4f49-a6e2-4a7550d33f15-openshift-service-ca" pod "4371accb-31eb-4f49-a6e2-4a7550d33f15" (UID: "4371accb-31eb-4f49-a6e2-4a7550d33f15"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:33:06.639129 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.637829    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4371accb-31eb-4f49-a6e2-4a7550d33f15-maas-api-tls" pod "4371accb-31eb-4f49-a6e2-4a7550d33f15" (UID: "4371accb-31eb-4f49-a6e2-4a7550d33f15"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:33:06.639307 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.638906    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4371accb-31eb-4f49-a6e2-4a7550d33f15-metrics-certs" pod "4371accb-31eb-4f49-a6e2-4a7550d33f15" (UID: "4371accb-31eb-4f49-a6e2-4a7550d33f15"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:33:06.651329 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.651260    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4371accb-31eb-4f49-a6e2-4a7550d33f15-kube-api-access-b8xj8" pod "4371accb-31eb-4f49-a6e2-4a7550d33f15" (UID: "4371accb-31eb-4f49-a6e2-4a7550d33f15"). InnerVolumeSpecName "kube-api-access-b8xj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:33:06.736943 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.736903    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4371accb-31eb-4f49-a6e2-4a7550d33f15-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:33:06.736943 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.736936    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4371accb-31eb-4f49-a6e2-4a7550d33f15-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:33:06.736943 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.736947    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4371accb-31eb-4f49-a6e2-4a7550d33f15-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:33:06.737173 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.736958    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8xj8\" (UniqueName: \"kubernetes.io/projected/4371accb-31eb-4f49-a6e2-4a7550d33f15-kube-api-access-b8xj8\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:33:06.856150 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.856067    5021 generic.go:356] "Generic (PLEG): container finished" podID="4371accb-31eb-4f49-a6e2-4a7550d33f15" containerID="0a62e052f501832dd2f0e0bb66ecb3f850682d639a262e10e3cfb4dbb1c21ab2" exitCode=0
Nov 03 17:33:06.856150 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.856104    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"
Nov 03 17:33:06.856349 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.856148    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9" event={"ID":"4371accb-31eb-4f49-a6e2-4a7550d33f15","Type":"ContainerDied","Data":"0a62e052f501832dd2f0e0bb66ecb3f850682d639a262e10e3cfb4dbb1c21ab2"}
Nov 03 17:33:06.856349 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.856203    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9" event={"ID":"4371accb-31eb-4f49-a6e2-4a7550d33f15","Type":"ContainerDied","Data":"7e204c1504413219debe6d0d85c1c7cabbd0c9006b8a8c68c0357f3e089f8c5e"}
Nov 03 17:33:06.856349 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.856254    5021 scope.go:122] "RemoveContainer" containerID="0a62e052f501832dd2f0e0bb66ecb3f850682d639a262e10e3cfb4dbb1c21ab2"
Nov 03 17:33:06.867117 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.867093    5021 scope.go:122] "RemoveContainer" containerID="0a62e052f501832dd2f0e0bb66ecb3f850682d639a262e10e3cfb4dbb1c21ab2"
Nov 03 17:33:06.867477 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:33:06.867448    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a62e052f501832dd2f0e0bb66ecb3f850682d639a262e10e3cfb4dbb1c21ab2\": container with ID starting with 0a62e052f501832dd2f0e0bb66ecb3f850682d639a262e10e3cfb4dbb1c21ab2 not found: ID does not exist" containerID="0a62e052f501832dd2f0e0bb66ecb3f850682d639a262e10e3cfb4dbb1c21ab2"
Nov 03 17:33:06.867575 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:06.867486    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a62e052f501832dd2f0e0bb66ecb3f850682d639a262e10e3cfb4dbb1c21ab2"} err="failed to get container status \"0a62e052f501832dd2f0e0bb66ecb3f850682d639a262e10e3cfb4dbb1c21ab2\": rpc error: code = NotFound desc = could not find container \"0a62e052f501832dd2f0e0bb66ecb3f850682d639a262e10e3cfb4dbb1c21ab2\": container with ID starting with 0a62e052f501832dd2f0e0bb66ecb3f850682d639a262e10e3cfb4dbb1c21ab2 not found: ID does not exist"
Nov 03 17:33:07.027721 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:07.027682    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"]
Nov 03 17:33:07.033015 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:07.032986    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-3e5c4d-64b77757d-hmkq9"]
Nov 03 17:33:07.046726 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:33:07.046697    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:33:08.003558 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:08.003523    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4371accb-31eb-4f49-a6e2-4a7550d33f15" path="/var/lib/kubelet/pods/4371accb-31eb-4f49-a6e2-4a7550d33f15/volumes"
Nov 03 17:33:11.107472 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.107435    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"]
Nov 03 17:33:11.108420 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.108397    5021 cpu_manager.go:414] "containerMap: removing container" podUID="4371accb-31eb-4f49-a6e2-4a7550d33f15" containerName="maas-api"
Nov 03 17:33:11.108480 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.108423    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4371accb-31eb-4f49-a6e2-4a7550d33f15" containerName="maas-api"
Nov 03 17:33:11.108617 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.108605    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="4371accb-31eb-4f49-a6e2-4a7550d33f15" containerName="maas-api"
Nov 03 17:33:11.113912 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.113891    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.192766 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.192732    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw499\" (UniqueName: \"kubernetes.io/projected/6169adba-c568-4897-85e2-5a0c5b106570-kube-api-access-gw499\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.193103 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.193081    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-istio-data\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.193354 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.193325    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6169adba-c568-4897-85e2-5a0c5b106570-istiod-ca-cert\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.193483 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.193377    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-workload-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.193483 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.193441    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6169adba-c568-4897-85e2-5a0c5b106570-istio-podinfo\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.193609 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.193511    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-credential-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.193609 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.193556    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-workload-certs\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.193609 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.193584    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-istio-envoy\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.193761 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.193609    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6169adba-c568-4897-85e2-5a0c5b106570-istio-token\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.242686 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.242647    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"]
Nov 03 17:33:11.294921 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.294884    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-istio-data\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.295116 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.294935    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6169adba-c568-4897-85e2-5a0c5b106570-istiod-ca-cert\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.295116 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.294973    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-workload-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.295116 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.295010    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6169adba-c568-4897-85e2-5a0c5b106570-istio-podinfo\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.295321 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.295170    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-credential-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.295321 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.295261    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-workload-certs\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.295321 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.295292    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-istio-envoy\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.295321 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.295315    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6169adba-c568-4897-85e2-5a0c5b106570-istio-token\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.295545 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.295381    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw499\" (UniqueName: \"kubernetes.io/projected/6169adba-c568-4897-85e2-5a0c5b106570-kube-api-access-gw499\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.295545 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.295389    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-istio-data\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.295545 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.295462    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-workload-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.295703 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.295558    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-credential-socket\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.295806 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.295786    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6169adba-c568-4897-85e2-5a0c5b106570-istiod-ca-cert\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.295900 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.295785    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-workload-certs\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.297665 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.297641    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-istio-envoy\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.297780 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.297764    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6169adba-c568-4897-85e2-5a0c5b106570-istio-podinfo\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.361959 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.361848    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6169adba-c568-4897-85e2-5a0c5b106570-istio-token\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.361959 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.361880    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw499\" (UniqueName: \"kubernetes.io/projected/6169adba-c568-4897-85e2-5a0c5b106570-kube-api-access-gw499\") pod \"e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") " pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.430033 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.430002    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:11.868839 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:33:11.868804    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6169adba_c568_4897_85e2_5a0c5b106570.slice/crio-61f04e87757cc019e92a30313e807ee494f8b080697a8bb1eba9369146c4de77 WatchSource:0}: Error finding container 61f04e87757cc019e92a30313e807ee494f8b080697a8bb1eba9369146c4de77: Status 404 returned error can't find the container with id 61f04e87757cc019e92a30313e807ee494f8b080697a8bb1eba9369146c4de77
Nov 03 17:33:11.870259 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.870197    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"]
Nov 03 17:33:11.875511 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.875470    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:33:11.875609 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.875567    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:33:11.875654 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.875615    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:33:11.898448 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:11.898410    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj" event={"ID":"6169adba-c568-4897-85e2-5a0c5b106570","Type":"ContainerStarted","Data":"61f04e87757cc019e92a30313e807ee494f8b080697a8bb1eba9369146c4de77"}
Nov 03 17:33:12.905917 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:12.905883    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj" event={"ID":"6169adba-c568-4897-85e2-5a0c5b106570","Type":"ContainerStarted","Data":"8da0bc046b75424bb3c4824f9b61dd6fae12f7628bf91d88de16b494f67320df"}
Nov 03 17:33:13.036250 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:13.034046    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj" podStartSLOduration=2.034025996 podStartE2EDuration="2.034025996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:33:13.032734864 +0000 UTC m=+993.234072956" watchObservedRunningTime="2026-11-03 17:33:13.034025996 +0000 UTC m=+993.235364049"
Nov 03 17:33:13.453251 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:13.452307    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:13.457094 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:13.457060    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 03 17:33:13.457269 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:13.457126    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj" podUID="6169adba-c568-4897-85e2-5a0c5b106570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 03 17:33:14.430665 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:14.430626    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 03 17:33:14.431283 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:14.431250    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj" podUID="6169adba-c568-4897-85e2-5a0c5b106570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 03 17:33:15.445250 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:15.438597    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 03 17:33:15.445250 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:15.438660    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj" podUID="6169adba-c568-4897-85e2-5a0c5b106570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 03 17:33:16.447502 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:16.447464    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 03 17:33:16.448922 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:16.448891    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj" podUID="6169adba-c568-4897-85e2-5a0c5b106570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 03 17:33:17.448249 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:17.432785    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 03 17:33:17.448249 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:17.432847    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj" podUID="6169adba-c568-4897-85e2-5a0c5b106570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 03 17:33:18.431449 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:18.431411    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Nov 03 17:33:18.431631 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:18.431476    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj" podUID="6169adba-c568-4897-85e2-5a0c5b106570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Nov 03 17:33:19.435989 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:19.435955    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:19.436403 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:19.436250    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:19.436855 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:19.436839    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:33:24.586459 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:24.586421    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"]
Nov 03 17:33:24.591765 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:24.591739    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"
Nov 03 17:33:24.639651 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:24.639615    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"]
Nov 03 17:33:24.688042 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:24.688010    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-extmod-a-029ca0\""
Nov 03 17:33:24.688238 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:24.688125    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-extmod-a-029ca0-dockercfg-cd8zn\""
Nov 03 17:33:24.693717 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:24.693694    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz52w\" (UniqueName: \"kubernetes.io/projected/61d174d5-ff58-4d7f-b821-c30c2ba74ba7-kube-api-access-vz52w\") pod \"payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj\" (UID: \"61d174d5-ff58-4d7f-b821-c30c2ba74ba7\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"
Nov 03 17:33:24.693900 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:24.693877    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61d174d5-ff58-4d7f-b821-c30c2ba74ba7-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj\" (UID: \"61d174d5-ff58-4d7f-b821-c30c2ba74ba7\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"
Nov 03 17:33:24.794797 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:24.794765    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz52w\" (UniqueName: \"kubernetes.io/projected/61d174d5-ff58-4d7f-b821-c30c2ba74ba7-kube-api-access-vz52w\") pod \"payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj\" (UID: \"61d174d5-ff58-4d7f-b821-c30c2ba74ba7\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"
Nov 03 17:33:24.794987 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:24.794888    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61d174d5-ff58-4d7f-b821-c30c2ba74ba7-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj\" (UID: \"61d174d5-ff58-4d7f-b821-c30c2ba74ba7\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"
Nov 03 17:33:24.795594 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:24.795574    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61d174d5-ff58-4d7f-b821-c30c2ba74ba7-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj\" (UID: \"61d174d5-ff58-4d7f-b821-c30c2ba74ba7\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"
Nov 03 17:33:24.858394 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:24.858324    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz52w\" (UniqueName: \"kubernetes.io/projected/61d174d5-ff58-4d7f-b821-c30c2ba74ba7-kube-api-access-vz52w\") pod \"payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj\" (UID: \"61d174d5-ff58-4d7f-b821-c30c2ba74ba7\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"
Nov 03 17:33:24.908142 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:24.908110    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"
Nov 03 17:33:25.285684 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:25.285657    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"]
Nov 03 17:33:25.286325 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:33:25.286302    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d174d5_ff58_4d7f_b821_c30c2ba74ba7.slice/crio-6beac8013bc4985b1a7d0e86d9b2e35cf55f511f6fcdaec025bdaef5acf49be7 WatchSource:0}: Error finding container 6beac8013bc4985b1a7d0e86d9b2e35cf55f511f6fcdaec025bdaef5acf49be7: Status 404 returned error can't find the container with id 6beac8013bc4985b1a7d0e86d9b2e35cf55f511f6fcdaec025bdaef5acf49be7
Nov 03 17:33:26.016601 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:26.016566    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj" event={"ID":"61d174d5-ff58-4d7f-b821-c30c2ba74ba7","Type":"ContainerStarted","Data":"7c92c9a3855c9338776909701f0e6a0ddd2b1f38c7cb56da8665b5c156513022"}
Nov 03 17:33:26.017064 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:26.016616    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj" event={"ID":"61d174d5-ff58-4d7f-b821-c30c2ba74ba7","Type":"ContainerStarted","Data":"6beac8013bc4985b1a7d0e86d9b2e35cf55f511f6fcdaec025bdaef5acf49be7"}
Nov 03 17:33:26.017064 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:26.016653    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"
Nov 03 17:33:26.138525 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:26.138473    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj" podStartSLOduration=2.13845914 podStartE2EDuration="2.13845914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:33:26.136738494 +0000 UTC m=+1006.338076550" watchObservedRunningTime="2026-11-03 17:33:26.13845914 +0000 UTC m=+1006.339797259"
Nov 03 17:33:37.026390 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:37.026363    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"
Nov 03 17:33:37.046398 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:33:37.046367    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:33:50.792633 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:50.792552    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"]
Nov 03 17:33:50.796976 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:50.796958    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 17:33:50.825999 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:50.825964    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849\" (UID: \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 17:33:50.826142 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:50.826012    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-metrics-certs\") pod \"maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849\" (UID: \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 17:33:50.826185 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:50.826137    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-maas-api-tls\") pod \"maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849\" (UID: \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 17:33:50.826261 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:50.826241    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw7px\" (UniqueName: \"kubernetes.io/projected/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-kube-api-access-cw7px\") pod \"maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849\" (UID: \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 17:33:50.865295 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:50.865261    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"]
Nov 03 17:33:50.911614 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:50.911569    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-a-029ca0-serving-cert\""
Nov 03 17:33:50.927635 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:50.927594    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849\" (UID: \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 17:33:50.927827 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:50.927660    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-metrics-certs\") pod \"maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849\" (UID: \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 17:33:50.927827 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:50.927759    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-maas-api-tls\") pod \"maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849\" (UID: \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 17:33:50.927950 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:50.927843    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw7px\" (UniqueName: \"kubernetes.io/projected/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-kube-api-access-cw7px\") pod \"maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849\" (UID: \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 17:33:50.928415 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:50.928388    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849\" (UID: \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 17:33:50.928687 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:33:50.928631    5021 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-serving-cert: secret "maas-api-e2e-extmod-a-029ca0-serving-cert" not found
Nov 03 17:33:50.928806 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:33:50.928729    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-maas-api-tls podName:8f9281de-ca0d-436e-b6d2-c0e371cc8bfd nodeName:}" failed. No retries permitted until 2026-11-03 17:33:51.428709905 +0000 UTC m=+1031.630047935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-maas-api-tls") pod "maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849" (UID: "8f9281de-ca0d-436e-b6d2-c0e371cc8bfd") : secret "maas-api-e2e-extmod-a-029ca0-serving-cert" not found
Nov 03 17:33:50.931513 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:50.931489    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-metrics-certs\") pod \"maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849\" (UID: \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 17:33:50.994770 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:50.994741    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw7px\" (UniqueName: \"kubernetes.io/projected/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-kube-api-access-cw7px\") pod \"maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849\" (UID: \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 17:33:51.433950 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:51.433919    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-maas-api-tls\") pod \"maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849\" (UID: \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 17:33:51.436489 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:51.436455    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-maas-api-tls\") pod \"maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849\" (UID: \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 17:33:51.710316 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:51.710208    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 17:33:52.095641 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:52.095612    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"]
Nov 03 17:33:52.096012 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:33:52.095977    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9281de_ca0d_436e_b6d2_c0e371cc8bfd.slice/crio-ec79105362aeda0db588bbf8ac2f46a132c83197322fc6ac887915b74e0b7329 WatchSource:0}: Error finding container ec79105362aeda0db588bbf8ac2f46a132c83197322fc6ac887915b74e0b7329: Status 404 returned error can't find the container with id ec79105362aeda0db588bbf8ac2f46a132c83197322fc6ac887915b74e0b7329
Nov 03 17:33:52.097477 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:52.097451    5021 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 17:33:52.224121 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:52.224084    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849" event={"ID":"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd","Type":"ContainerStarted","Data":"ec79105362aeda0db588bbf8ac2f46a132c83197322fc6ac887915b74e0b7329"}
Nov 03 17:33:53.232005 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:53.231970    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849" event={"ID":"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd","Type":"ContainerStarted","Data":"d8451349b30ff0e304bf4e3457c0417401665b7a6bc700c47bed9ee647618bd8"}
Nov 03 17:33:53.232431 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:53.232055    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 17:33:53.363986 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:53.363928    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849" podStartSLOduration=2.475002502 podStartE2EDuration="3.363915484s" totalImagesPullingTime="888.912982ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:33:53.363039747 +0000 UTC m=+1033.564377801" watchObservedRunningTime="2026-11-03 17:33:53.363915484 +0000 UTC m=+1033.565253571"
Nov 03 17:33:59.244280 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:33:59.244212    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 17:34:00.107551 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:00.107511    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"]
Nov 03 17:34:00.107776 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:00.107748    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45" podUID="06db63cd-7185-4e45-9930-8e1b6a018d32" containerName="istio-proxy" containerID="cri-o://6f0681fc28363d52057aa9cc8922aae0b0bc733b9ba669ff1c064869abffd9f9" gracePeriod=30
Nov 03 17:34:05.318088 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.318050    5021 generic.go:356] "Generic (PLEG): container finished" podID="06db63cd-7185-4e45-9930-8e1b6a018d32" containerID="6f0681fc28363d52057aa9cc8922aae0b0bc733b9ba669ff1c064869abffd9f9" exitCode=0
Nov 03 17:34:05.318487 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.318098    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45" event={"ID":"06db63cd-7185-4e45-9930-8e1b6a018d32","Type":"ContainerDied","Data":"6f0681fc28363d52057aa9cc8922aae0b0bc733b9ba669ff1c064869abffd9f9"}
Nov 03 17:34:05.403431 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.403384    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:34:05.506460 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.506423    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-credential-socket\") pod \"06db63cd-7185-4e45-9930-8e1b6a018d32\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") "
Nov 03 17:34:05.506699 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.506674    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-credential-socket" pod "06db63cd-7185-4e45-9930-8e1b6a018d32" (UID: "06db63cd-7185-4e45-9930-8e1b6a018d32"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:34:05.506853 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.506833    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-envoy\") pod \"06db63cd-7185-4e45-9930-8e1b6a018d32\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") "
Nov 03 17:34:05.506956 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.506876    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-data\") pod \"06db63cd-7185-4e45-9930-8e1b6a018d32\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") "
Nov 03 17:34:05.507022 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.506951    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-workload-socket\") pod \"06db63cd-7185-4e45-9930-8e1b6a018d32\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") "
Nov 03 17:34:05.507022 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.506988    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06db63cd-7185-4e45-9930-8e1b6a018d32-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06db63cd-7185-4e45-9930-8e1b6a018d32-istiod-ca-cert\") pod \"06db63cd-7185-4e45-9930-8e1b6a018d32\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") "
Nov 03 17:34:05.507122 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.507056    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-token\" (UniqueName: \"kubernetes.io/projected/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-token\") pod \"06db63cd-7185-4e45-9930-8e1b6a018d32\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") "
Nov 03 17:34:05.507122 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.507095    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-workload-certs\") pod \"06db63cd-7185-4e45-9930-8e1b6a018d32\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") "
Nov 03 17:34:05.507243 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.507158    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06db63cd-7185-4e45-9930-8e1b6a018d32-kube-api-access-mgbbh\" (UniqueName: \"kubernetes.io/projected/06db63cd-7185-4e45-9930-8e1b6a018d32-kube-api-access-mgbbh\") pod \"06db63cd-7185-4e45-9930-8e1b6a018d32\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") "
Nov 03 17:34:05.507305 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.507284    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-podinfo\") pod \"06db63cd-7185-4e45-9930-8e1b6a018d32\" (UID: \"06db63cd-7185-4e45-9930-8e1b6a018d32\") "
Nov 03 17:34:05.507649 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.507613    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06db63cd-7185-4e45-9930-8e1b6a018d32-istiod-ca-cert" pod "06db63cd-7185-4e45-9930-8e1b6a018d32" (UID: "06db63cd-7185-4e45-9930-8e1b6a018d32"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:34:05.507737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.507695    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06db63cd-7185-4e45-9930-8e1b6a018d32-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:34:05.507737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.507717    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:34:05.507893 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.507869    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-data" pod "06db63cd-7185-4e45-9930-8e1b6a018d32" (UID: "06db63cd-7185-4e45-9930-8e1b6a018d32"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:34:05.508817 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.508777    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-workload-certs" pod "06db63cd-7185-4e45-9930-8e1b6a018d32" (UID: "06db63cd-7185-4e45-9930-8e1b6a018d32"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:34:05.510259 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.510213    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-workload-socket" pod "06db63cd-7185-4e45-9930-8e1b6a018d32" (UID: "06db63cd-7185-4e45-9930-8e1b6a018d32"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:34:05.510830 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.510795    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-envoy" pod "06db63cd-7185-4e45-9930-8e1b6a018d32" (UID: "06db63cd-7185-4e45-9930-8e1b6a018d32"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:34:05.511626 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.511600    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-token" pod "06db63cd-7185-4e45-9930-8e1b6a018d32" (UID: "06db63cd-7185-4e45-9930-8e1b6a018d32"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:34:05.512298 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.512272    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-podinfo" pod "06db63cd-7185-4e45-9930-8e1b6a018d32" (UID: "06db63cd-7185-4e45-9930-8e1b6a018d32"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 17:34:05.512413 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.512396    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06db63cd-7185-4e45-9930-8e1b6a018d32-kube-api-access-mgbbh" pod "06db63cd-7185-4e45-9930-8e1b6a018d32" (UID: "06db63cd-7185-4e45-9930-8e1b6a018d32"). InnerVolumeSpecName "kube-api-access-mgbbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:34:05.608702 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.608670    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:34:05.608702 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.608701    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:34:05.608909 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.608714    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:34:05.608909 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.608728    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:34:05.608909 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.608739    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06db63cd-7185-4e45-9930-8e1b6a018d32-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:34:05.608909 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.608751    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgbbh\" (UniqueName: \"kubernetes.io/projected/06db63cd-7185-4e45-9930-8e1b6a018d32-kube-api-access-mgbbh\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:34:05.608909 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:05.608763    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06db63cd-7185-4e45-9930-8e1b6a018d32-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:34:06.328458 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:06.328359    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"
Nov 03 17:34:06.328458 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:06.328391    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45" event={"ID":"06db63cd-7185-4e45-9930-8e1b6a018d32","Type":"ContainerDied","Data":"613a159d1aed67b365ac89c0ebbfd25b538187c59c8aea6ec1e818160d4c8a56"}
Nov 03 17:34:06.328985 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:06.328473    5021 scope.go:122] "RemoveContainer" containerID="6f0681fc28363d52057aa9cc8922aae0b0bc733b9ba669ff1c064869abffd9f9"
Nov 03 17:34:06.557588 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:06.557437    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"]
Nov 03 17:34:06.563999 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:06.563965    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-nnt45"]
Nov 03 17:34:07.109527 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:34:07.109486    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:34:08.003738 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:08.003703    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="06db63cd-7185-4e45-9930-8e1b6a018d32" path="/var/lib/kubelet/pods/06db63cd-7185-4e45-9930-8e1b6a018d32/volumes"
Nov 03 17:34:33.571846 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.571799    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-42w9f-xjq2f"]
Nov 03 17:34:33.583362 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.583320    5021 cpu_manager.go:414] "containerMap: removing container" podUID="06db63cd-7185-4e45-9930-8e1b6a018d32" containerName="istio-proxy"
Nov 03 17:34:33.583604 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.583584    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06db63cd-7185-4e45-9930-8e1b6a018d32" containerName="istio-proxy"
Nov 03 17:34:33.583921 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.583902    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="06db63cd-7185-4e45-9930-8e1b6a018d32" containerName="istio-proxy"
Nov 03 17:34:33.679644 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.679613    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-42w9f-xjq2f"]
Nov 03 17:34:33.680105 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.680013    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-42w9f-xjq2f"
Nov 03 17:34:33.762258 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.754051    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dnj2\" (UniqueName: \"kubernetes.io/projected/6a280ed7-f646-402e-98d2-be44a023306c-kube-api-access-5dnj2\") pod \"periodic-gathering-42w9f-xjq2f\" (UID: \"6a280ed7-f646-402e-98d2-be44a023306c\") " pod="openshift-insights/periodic-gathering-42w9f-xjq2f"
Nov 03 17:34:33.762258 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.754119    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a280ed7-f646-402e-98d2-be44a023306c-service-ca-bundle\") pod \"periodic-gathering-42w9f-xjq2f\" (UID: \"6a280ed7-f646-402e-98d2-be44a023306c\") " pod="openshift-insights/periodic-gathering-42w9f-xjq2f"
Nov 03 17:34:33.762258 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.754199    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a280ed7-f646-402e-98d2-be44a023306c-trusted-ca-bundle\") pod \"periodic-gathering-42w9f-xjq2f\" (UID: \"6a280ed7-f646-402e-98d2-be44a023306c\") " pod="openshift-insights/periodic-gathering-42w9f-xjq2f"
Nov 03 17:34:33.771251 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.762808    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6a280ed7-f646-402e-98d2-be44a023306c-archives-path\") pod \"periodic-gathering-42w9f-xjq2f\" (UID: \"6a280ed7-f646-402e-98d2-be44a023306c\") " pod="openshift-insights/periodic-gathering-42w9f-xjq2f"
Nov 03 17:34:33.820690 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.820445    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-57r42\""
Nov 03 17:34:33.896566 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.876096    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dnj2\" (UniqueName: \"kubernetes.io/projected/6a280ed7-f646-402e-98d2-be44a023306c-kube-api-access-5dnj2\") pod \"periodic-gathering-42w9f-xjq2f\" (UID: \"6a280ed7-f646-402e-98d2-be44a023306c\") " pod="openshift-insights/periodic-gathering-42w9f-xjq2f"
Nov 03 17:34:33.896881 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.896844    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a280ed7-f646-402e-98d2-be44a023306c-service-ca-bundle\") pod \"periodic-gathering-42w9f-xjq2f\" (UID: \"6a280ed7-f646-402e-98d2-be44a023306c\") " pod="openshift-insights/periodic-gathering-42w9f-xjq2f"
Nov 03 17:34:33.897126 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.897097    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a280ed7-f646-402e-98d2-be44a023306c-trusted-ca-bundle\") pod \"periodic-gathering-42w9f-xjq2f\" (UID: \"6a280ed7-f646-402e-98d2-be44a023306c\") " pod="openshift-insights/periodic-gathering-42w9f-xjq2f"
Nov 03 17:34:33.897412 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.897394    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6a280ed7-f646-402e-98d2-be44a023306c-archives-path\") pod \"periodic-gathering-42w9f-xjq2f\" (UID: \"6a280ed7-f646-402e-98d2-be44a023306c\") " pod="openshift-insights/periodic-gathering-42w9f-xjq2f"
Nov 03 17:34:33.898432 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.898407    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a280ed7-f646-402e-98d2-be44a023306c-service-ca-bundle\") pod \"periodic-gathering-42w9f-xjq2f\" (UID: \"6a280ed7-f646-402e-98d2-be44a023306c\") " pod="openshift-insights/periodic-gathering-42w9f-xjq2f"
Nov 03 17:34:33.934295 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.900270    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a280ed7-f646-402e-98d2-be44a023306c-trusted-ca-bundle\") pod \"periodic-gathering-42w9f-xjq2f\" (UID: \"6a280ed7-f646-402e-98d2-be44a023306c\") " pod="openshift-insights/periodic-gathering-42w9f-xjq2f"
Nov 03 17:34:33.934569 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:33.900528    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6a280ed7-f646-402e-98d2-be44a023306c-archives-path\") pod \"periodic-gathering-42w9f-xjq2f\" (UID: \"6a280ed7-f646-402e-98d2-be44a023306c\") " pod="openshift-insights/periodic-gathering-42w9f-xjq2f"
Nov 03 17:34:34.084485 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:34.084449    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dnj2\" (UniqueName: \"kubernetes.io/projected/6a280ed7-f646-402e-98d2-be44a023306c-kube-api-access-5dnj2\") pod \"periodic-gathering-42w9f-xjq2f\" (UID: \"6a280ed7-f646-402e-98d2-be44a023306c\") " pod="openshift-insights/periodic-gathering-42w9f-xjq2f"
Nov 03 17:34:34.147960 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:34.147878    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-42w9f-xjq2f"
Nov 03 17:34:34.920584 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:34.920553    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-42w9f-xjq2f"]
Nov 03 17:34:34.922377 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:34:34.922352    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a280ed7_f646_402e_98d2_be44a023306c.slice/crio-06697e7629c12b53843d2aa9bd8ebc48260ed87310f7823a0f7e280e353ba3fb WatchSource:0}: Error finding container 06697e7629c12b53843d2aa9bd8ebc48260ed87310f7823a0f7e280e353ba3fb: Status 404 returned error can't find the container with id 06697e7629c12b53843d2aa9bd8ebc48260ed87310f7823a0f7e280e353ba3fb
Nov 03 17:34:35.633852 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:35.633810    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-42w9f-xjq2f" event={"ID":"6a280ed7-f646-402e-98d2-be44a023306c","Type":"ContainerStarted","Data":"db607d8a0f9066671ff3b46ac51f9f06652c9bb556eeb664c9bbc1cb3d81c27f"}
Nov 03 17:34:35.634023 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:35.633877    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-42w9f-xjq2f" event={"ID":"6a280ed7-f646-402e-98d2-be44a023306c","Type":"ContainerStarted","Data":"06697e7629c12b53843d2aa9bd8ebc48260ed87310f7823a0f7e280e353ba3fb"}
Nov 03 17:34:35.757151 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:35.757088    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-42w9f-xjq2f" podStartSLOduration=2.757073988 podStartE2EDuration="2.757073988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:34:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:34:35.75547811 +0000 UTC m=+1075.956816162" watchObservedRunningTime="2026-11-03 17:34:35.757073988 +0000 UTC m=+1075.958412039"
Nov 03 17:34:37.047080 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:34:37.047046    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:34:50.356389 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:50.356345    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 17:34:50.361368 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:50.361324    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z" podUID="f8f2cfcf-bea5-4a8f-b78e-70779445cee7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 17:34:50.487829 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:50.487786    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 17:34:50.488135 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:34:50.488104    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj" podUID="6169adba-c568-4897-85e2-5a0c5b106570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 17:35:05.291261 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:05.290330    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 17:35:05.291261 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:05.290407    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w" podUID="31cf4b70-4b18-4711-aedd-31bf4c9a987f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 17:35:05.326386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:05.326344    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 17:35:05.326670 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:05.326634    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj" podUID="1533139a-853a-4ca5-9c43-494ae9b29681" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 17:35:07.103898 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:35:07.103845    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:35:22.092264 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:22.086829    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"]
Nov 03 17:35:22.098458 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:22.098432    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 17:35:22.108056 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:22.108016    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-maas-api-tls\") pod \"maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt\" (UID: \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 17:35:22.108196 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:22.108134    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-metrics-certs\") pod \"maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt\" (UID: \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 17:35:22.108196 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:22.108183    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt\" (UID: \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 17:35:22.108357 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:22.108293    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbk8j\" (UniqueName: \"kubernetes.io/projected/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-kube-api-access-rbk8j\") pod \"maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt\" (UID: \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 17:35:22.168250 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:22.167662    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"]
Nov 03 17:35:22.194590 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:22.194558    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-b-8c9b0f-serving-cert\""
Nov 03 17:35:22.209382 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:22.209343    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt\" (UID: \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 17:35:22.209741 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:22.209709    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbk8j\" (UniqueName: \"kubernetes.io/projected/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-kube-api-access-rbk8j\") pod \"maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt\" (UID: \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 17:35:22.210400 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:22.210174    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt\" (UID: \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 17:35:22.210625 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:22.210585    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-maas-api-tls\") pod \"maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt\" (UID: \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 17:35:22.210970 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:35:22.210845    5021 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-serving-cert: secret "maas-api-e2e-extmod-b-8c9b0f-serving-cert" not found
Nov 03 17:35:22.211193 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:35:22.211179    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-maas-api-tls podName:d90cf5c8-5c49-4e06-8d36-73692a13e8c6 nodeName:}" failed. No retries permitted until 2026-11-03 17:35:22.711137651 +0000 UTC m=+1122.912475697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-maas-api-tls") pod "maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt" (UID: "d90cf5c8-5c49-4e06-8d36-73692a13e8c6") : secret "maas-api-e2e-extmod-b-8c9b0f-serving-cert" not found
Nov 03 17:35:22.211534 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:22.211512    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-metrics-certs\") pod \"maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt\" (UID: \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 17:35:22.215260 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:22.214438    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-metrics-certs\") pod \"maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt\" (UID: \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 17:35:22.337256 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:22.324154    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbk8j\" (UniqueName: \"kubernetes.io/projected/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-kube-api-access-rbk8j\") pod \"maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt\" (UID: \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 17:35:22.798839 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:22.798801    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-maas-api-tls\") pod \"maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt\" (UID: \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 17:35:22.801299 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:22.801279    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-maas-api-tls\") pod \"maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt\" (UID: \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 17:35:23.015473 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:23.015440    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 17:35:23.400355 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:23.400326    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"]
Nov 03 17:35:23.400787 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:35:23.400464    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd90cf5c8_5c49_4e06_8d36_73692a13e8c6.slice/crio-d289f229aba5078c79c1d315da5f73eebe17fbdf305b106d47eaa18e5a9c33a0 WatchSource:0}: Error finding container d289f229aba5078c79c1d315da5f73eebe17fbdf305b106d47eaa18e5a9c33a0: Status 404 returned error can't find the container with id d289f229aba5078c79c1d315da5f73eebe17fbdf305b106d47eaa18e5a9c33a0
Nov 03 17:35:23.532672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:23.532636    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt" event={"ID":"d90cf5c8-5c49-4e06-8d36-73692a13e8c6","Type":"ContainerStarted","Data":"d289f229aba5078c79c1d315da5f73eebe17fbdf305b106d47eaa18e5a9c33a0"}
Nov 03 17:35:24.547453 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:24.547419    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt" event={"ID":"d90cf5c8-5c49-4e06-8d36-73692a13e8c6","Type":"ContainerStarted","Data":"4714766fb6a73e7ebc3a3759eb06e70146d08deda163cd65cba92c8766e13e7b"}
Nov 03 17:35:24.547855 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:24.547509    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 17:35:24.702488 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:24.702389    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt" podStartSLOduration=1.662227967 podStartE2EDuration="2.702375514s" totalImagesPullingTime="1.040147547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:35:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:35:24.699794035 +0000 UTC m=+1124.901132086" watchObservedRunningTime="2026-11-03 17:35:24.702375514 +0000 UTC m=+1124.903713566"
Nov 03 17:35:30.559069 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:30.559039    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 17:35:34.823252 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:34.822330    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 17:35:34.823252 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:34.822425    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s" podUID="a2de9f7c-8a08-4b83-af23-04ef58ff5739" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 17:35:35.492429 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:35.492385    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 17:35:35.492774 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:35:35.492722    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj" podUID="6169adba-c568-4897-85e2-5a0c5b106570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 17:35:37.046684 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:35:37.046647    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:36:07.045944 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:36:07.045906    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:36:14.116183 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:14.116146    5021 generic.go:356] "Generic (PLEG): container finished" podID="6a280ed7-f646-402e-98d2-be44a023306c" containerID="db607d8a0f9066671ff3b46ac51f9f06652c9bb556eeb664c9bbc1cb3d81c27f" exitCode=0
Nov 03 17:36:14.116695 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:14.116216    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-42w9f-xjq2f" event={"ID":"6a280ed7-f646-402e-98d2-be44a023306c","Type":"ContainerDied","Data":"db607d8a0f9066671ff3b46ac51f9f06652c9bb556eeb664c9bbc1cb3d81c27f"}
Nov 03 17:36:15.322560 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:15.322528    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-42w9f-xjq2f"
Nov 03 17:36:15.388126 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:15.388047    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6a280ed7-f646-402e-98d2-be44a023306c-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6a280ed7-f646-402e-98d2-be44a023306c-archives-path\") pod \"6a280ed7-f646-402e-98d2-be44a023306c\" (UID: \"6a280ed7-f646-402e-98d2-be44a023306c\") "
Nov 03 17:36:15.388339 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:15.388147    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6a280ed7-f646-402e-98d2-be44a023306c-kube-api-access-5dnj2\" (UniqueName: \"kubernetes.io/projected/6a280ed7-f646-402e-98d2-be44a023306c-kube-api-access-5dnj2\") pod \"6a280ed7-f646-402e-98d2-be44a023306c\" (UID: \"6a280ed7-f646-402e-98d2-be44a023306c\") "
Nov 03 17:36:15.388339 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:15.388181    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6a280ed7-f646-402e-98d2-be44a023306c-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a280ed7-f646-402e-98d2-be44a023306c-trusted-ca-bundle\") pod \"6a280ed7-f646-402e-98d2-be44a023306c\" (UID: \"6a280ed7-f646-402e-98d2-be44a023306c\") "
Nov 03 17:36:15.388339 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:15.388272    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6a280ed7-f646-402e-98d2-be44a023306c-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a280ed7-f646-402e-98d2-be44a023306c-service-ca-bundle\") pod \"6a280ed7-f646-402e-98d2-be44a023306c\" (UID: \"6a280ed7-f646-402e-98d2-be44a023306c\") "
Nov 03 17:36:15.388512 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:15.388461    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a280ed7-f646-402e-98d2-be44a023306c-archives-path" pod "6a280ed7-f646-402e-98d2-be44a023306c" (UID: "6a280ed7-f646-402e-98d2-be44a023306c"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:36:15.388766 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:15.388730    5021 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6a280ed7-f646-402e-98d2-be44a023306c-archives-path\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:36:15.388766 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:15.388725    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a280ed7-f646-402e-98d2-be44a023306c-trusted-ca-bundle" pod "6a280ed7-f646-402e-98d2-be44a023306c" (UID: "6a280ed7-f646-402e-98d2-be44a023306c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:36:15.388963 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:15.388789    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a280ed7-f646-402e-98d2-be44a023306c-service-ca-bundle" pod "6a280ed7-f646-402e-98d2-be44a023306c" (UID: "6a280ed7-f646-402e-98d2-be44a023306c"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:36:15.390858 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:15.390832    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a280ed7-f646-402e-98d2-be44a023306c-kube-api-access-5dnj2" pod "6a280ed7-f646-402e-98d2-be44a023306c" (UID: "6a280ed7-f646-402e-98d2-be44a023306c"). InnerVolumeSpecName "kube-api-access-5dnj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:36:15.489572 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:15.489529    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dnj2\" (UniqueName: \"kubernetes.io/projected/6a280ed7-f646-402e-98d2-be44a023306c-kube-api-access-5dnj2\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:36:15.489572 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:15.489563    5021 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a280ed7-f646-402e-98d2-be44a023306c-trusted-ca-bundle\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:36:15.489572 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:15.489574    5021 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a280ed7-f646-402e-98d2-be44a023306c-service-ca-bundle\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:36:16.130809 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:16.130779    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-42w9f-xjq2f"
Nov 03 17:36:16.130809 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:16.130796    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-42w9f-xjq2f" event={"ID":"6a280ed7-f646-402e-98d2-be44a023306c","Type":"ContainerDied","Data":"06697e7629c12b53843d2aa9bd8ebc48260ed87310f7823a0f7e280e353ba3fb"}
Nov 03 17:36:16.131011 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:16.130849    5021 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06697e7629c12b53843d2aa9bd8ebc48260ed87310f7823a0f7e280e353ba3fb"
Nov 03 17:36:37.046389 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:36:37.046350    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:36:40.141241 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:40.141205    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:36:40.143164 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:36:40.143141    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:37:00.723406 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.723331    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"]
Nov 03 17:37:00.723946 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.723931    5021 cpu_manager.go:414] "containerMap: removing container" podUID="6a280ed7-f646-402e-98d2-be44a023306c" containerName="insights-gathering"
Nov 03 17:37:00.724003 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.723946    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6a280ed7-f646-402e-98d2-be44a023306c" containerName="insights-gathering"
Nov 03 17:37:00.724080 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.724071    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="6a280ed7-f646-402e-98d2-be44a023306c" containerName="insights-gathering"
Nov 03 17:37:00.727724 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.727704    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.777678 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.777644    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-dshm\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.777854 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.777727    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7kn2\" (UniqueName: \"kubernetes.io/projected/f7b69cb9-f649-4675-bf94-4633697601c5-kube-api-access-w7kn2\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.777930 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.777864    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-home\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.777999 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.777949    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7b69cb9-f649-4675-bf94-4633697601c5-tls-certs\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.778078 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.778060    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-model-cache\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.778144 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.778129    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-tmp-dir\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.784640 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.784603    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"]
Nov 03 17:37:00.832381 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.832354    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w4-147834\"/\"openshift-service-ca.crt\""
Nov 03 17:37:00.833211 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.833194    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w4-147834\"/\"kube-root-ca.crt\""
Nov 03 17:37:00.833403 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.833387    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w4-147834\"/\"rate-test-model-147834-kserve-self-signed-certs\""
Nov 03 17:37:00.836328 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.836314    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w4-147834\"/\"default-dockercfg-78pkk\""
Nov 03 17:37:00.880283 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.880191    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-tmp-dir\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.880603 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.880293    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-dshm\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.880713 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.880688    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-tmp-dir\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.880842 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.880820    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7kn2\" (UniqueName: \"kubernetes.io/projected/f7b69cb9-f649-4675-bf94-4633697601c5-kube-api-access-w7kn2\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.880940 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.880908    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-home\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.881342 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.881321    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7b69cb9-f649-4675-bf94-4633697601c5-tls-certs\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.881434 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.881372    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-home\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.881513 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.881457    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-model-cache\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.882995 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.882969    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-model-cache\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.883330 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.883309    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-dshm\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.884152 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.884127    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7b69cb9-f649-4675-bf94-4633697601c5-tls-certs\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:00.945367 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:00.945337    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7kn2\" (UniqueName: \"kubernetes.io/projected/f7b69cb9-f649-4675-bf94-4633697601c5-kube-api-access-w7kn2\") pod \"rate-test-model-147834-kserve-547f6c67c-lmpj4\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") " pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:01.040222 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:01.040189    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:01.442759 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:37:01.442723    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7b69cb9_f649_4675_bf94_4633697601c5.slice/crio-4cf83071b92b3a4a632976b678cf3908669d6ac0a87466a852fc71aefb4e6e51 WatchSource:0}: Error finding container 4cf83071b92b3a4a632976b678cf3908669d6ac0a87466a852fc71aefb4e6e51: Status 404 returned error can't find the container with id 4cf83071b92b3a4a632976b678cf3908669d6ac0a87466a852fc71aefb4e6e51
Nov 03 17:37:01.442871 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:01.442848    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"]
Nov 03 17:37:01.458315 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:01.458281    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4" event={"ID":"f7b69cb9-f649-4675-bf94-4633697601c5","Type":"ContainerStarted","Data":"4cf83071b92b3a4a632976b678cf3908669d6ac0a87466a852fc71aefb4e6e51"}
Nov 03 17:37:02.466551 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:02.466512    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4" event={"ID":"f7b69cb9-f649-4675-bf94-4633697601c5","Type":"ContainerStarted","Data":"aa7c8a9a233b1461429283b6a80029bfead3fc1fd4d8dfc9e5707b863ec44ea7"}
Nov 03 17:37:02.590386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:02.590333    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4" podStartSLOduration=2.5903180199999998 podStartE2EDuration="2.59031802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:37:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:37:02.587701973 +0000 UTC m=+1222.789040025" watchObservedRunningTime="2026-11-03 17:37:02.59031802 +0000 UTC m=+1222.791656079"
Nov 03 17:37:03.040880 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:03.040846    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:07.046156 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:37:07.046107    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:37:09.550195 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:09.550157    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"]
Nov 03 17:37:09.660136 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:09.660100    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"]
Nov 03 17:37:11.041963 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:11.041930    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:11.057657 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:11.057626    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:11.553704 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:11.553673    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:37:14.550667 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:14.550625    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh" podUID="cd9016e5-9676-4809-a81d-8f8aa1d08c8b" containerName="payload-processing" containerID="cri-o://22177679063c25d73cade5f78b73397cb964a120f5936f656fd1d06055a8d55e" gracePeriod=25
Nov 03 17:37:14.660720 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:14.660660    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg" podUID="dabcf1df-5d48-4e4b-8491-288ad2dfd279" containerName="payload-pre-processing" containerID="cri-o://0708edaf6cb5efaa39f0e828583a0554fd4f62fce75873423445851bb6d2b7fe" gracePeriod=25
Nov 03 17:37:22.478953 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:22.478915    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg" podUID="dabcf1df-5d48-4e4b-8491-288ad2dfd279" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:37:22.479381 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:22.478955    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh" podUID="cd9016e5-9676-4809-a81d-8f8aa1d08c8b" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:37:31.723344 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.723310    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"]
Nov 03 17:37:31.768308 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.768275    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.823925 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.823895    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w4-147834-openshift-default-dockercfg-2pfbf\""
Nov 03 17:37:31.851237 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.851188    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istiod-ca-cert\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.851510 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.851479    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-workload-socket\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.851713 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.851678    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-credential-socket\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.851877 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.851856    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-data\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.852022 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.852003    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-token\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.852184 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.852165    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-workload-certs\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.852348 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.852328    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-podinfo\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.852840 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.852810    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvwlh\" (UniqueName: \"kubernetes.io/projected/cf8a66ad-fe50-45f0-81ae-14cb438c3273-kube-api-access-qvwlh\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.853054 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.853035    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-envoy\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.921605 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.921562    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"]
Nov 03 17:37:31.981305 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.978574    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istiod-ca-cert\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.981305 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.978628    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-workload-socket\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.981305 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.978689    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-credential-socket\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.981305 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.978720    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-data\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.981305 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.978747    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-token\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.981305 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.978783    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-workload-certs\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.981305 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.978810    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-podinfo\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.981305 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.978985    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvwlh\" (UniqueName: \"kubernetes.io/projected/cf8a66ad-fe50-45f0-81ae-14cb438c3273-kube-api-access-qvwlh\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:31.981305 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.979052    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-envoy\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:32.000525 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.997764    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-data\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:32.000525 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.998940    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istiod-ca-cert\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:32.000525 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.999215    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-workload-socket\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:32.000525 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.999502    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-credential-socket\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:32.000525 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:31.999771    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-workload-certs\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:32.011371 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:32.011328    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-envoy\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:32.012659 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:32.012636    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-podinfo\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:32.082967 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:32.082921    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-token\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:32.099251 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:32.097287    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvwlh\" (UniqueName: \"kubernetes.io/projected/cf8a66ad-fe50-45f0-81ae-14cb438c3273-kube-api-access-qvwlh\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:32.111530 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:32.111500    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:32.493373 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:32.492888    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh" podUID="cd9016e5-9676-4809-a81d-8f8aa1d08c8b" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:37:32.495464 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:32.495398    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg" podUID="dabcf1df-5d48-4e4b-8491-288ad2dfd279" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:37:32.689064 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:32.689027    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"]
Nov 03 17:37:32.706267 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:37:32.706212    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf8a66ad_fe50_45f0_81ae_14cb438c3273.slice/crio-2818922b09034fa46f208c82be4a65490466252837bcb1d33bf6d3889a6a986c WatchSource:0}: Error finding container 2818922b09034fa46f208c82be4a65490466252837bcb1d33bf6d3889a6a986c: Status 404 returned error can't find the container with id 2818922b09034fa46f208c82be4a65490466252837bcb1d33bf6d3889a6a986c
Nov 03 17:37:32.708821 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:32.708786    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:37:32.708922 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:32.708860    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:37:32.708922 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:32.708895    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:37:32.718977 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:32.718950    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548" event={"ID":"cf8a66ad-fe50-45f0-81ae-14cb438c3273","Type":"ContainerStarted","Data":"2818922b09034fa46f208c82be4a65490466252837bcb1d33bf6d3889a6a986c"}
Nov 03 17:37:33.745249 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:33.742662    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548" event={"ID":"cf8a66ad-fe50-45f0-81ae-14cb438c3273","Type":"ContainerStarted","Data":"7e1aa6c126f7791c046427999fa2da12254a2eee5589120e2b7fde1eba962c71"}
Nov 03 17:37:33.871054 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:33.870991    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548" podStartSLOduration=2.870977643 podStartE2EDuration="2.870977643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:37:33.868627159 +0000 UTC m=+1254.069965208" watchObservedRunningTime="2026-11-03 17:37:33.870977643 +0000 UTC m=+1254.072315694"
Nov 03 17:37:34.112315 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:34.112280    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:34.114173 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:34.114144    5021 patch_prober.go:29] interesting pod/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 03 17:37:34.114313 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:34.114193    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548" podUID="cf8a66ad-fe50-45f0-81ae-14cb438c3273" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 03 17:37:34.769056 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:34.768211    5021 generic.go:356] "Generic (PLEG): container finished" podID="cd9016e5-9676-4809-a81d-8f8aa1d08c8b" containerID="22177679063c25d73cade5f78b73397cb964a120f5936f656fd1d06055a8d55e" exitCode=0
Nov 03 17:37:34.769056 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:34.768995    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh" event={"ID":"cd9016e5-9676-4809-a81d-8f8aa1d08c8b","Type":"ContainerDied","Data":"22177679063c25d73cade5f78b73397cb964a120f5936f656fd1d06055a8d55e"}
Nov 03 17:37:34.887195 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:34.887168    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"
Nov 03 17:37:34.963693 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:34.963659    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cd9016e5-9676-4809-a81d-8f8aa1d08c8b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd9016e5-9676-4809-a81d-8f8aa1d08c8b-plugins-config-volume\") pod \"cd9016e5-9676-4809-a81d-8f8aa1d08c8b\" (UID: \"cd9016e5-9676-4809-a81d-8f8aa1d08c8b\") "
Nov 03 17:37:34.964002 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:34.963981    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd9016e5-9676-4809-a81d-8f8aa1d08c8b-plugins-config-volume" pod "cd9016e5-9676-4809-a81d-8f8aa1d08c8b" (UID: "cd9016e5-9676-4809-a81d-8f8aa1d08c8b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:37:34.964119 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:34.964060    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cd9016e5-9676-4809-a81d-8f8aa1d08c8b-kube-api-access-k6gv7\" (UniqueName: \"kubernetes.io/projected/cd9016e5-9676-4809-a81d-8f8aa1d08c8b-kube-api-access-k6gv7\") pod \"cd9016e5-9676-4809-a81d-8f8aa1d08c8b\" (UID: \"cd9016e5-9676-4809-a81d-8f8aa1d08c8b\") "
Nov 03 17:37:34.964845 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:34.964738    5021 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd9016e5-9676-4809-a81d-8f8aa1d08c8b-plugins-config-volume\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:37:34.966807 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:34.966608    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd9016e5-9676-4809-a81d-8f8aa1d08c8b-kube-api-access-k6gv7" pod "cd9016e5-9676-4809-a81d-8f8aa1d08c8b" (UID: "cd9016e5-9676-4809-a81d-8f8aa1d08c8b"). InnerVolumeSpecName "kube-api-access-k6gv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:37:34.979558 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:34.979535    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"
Nov 03 17:37:35.065780 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.065741    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dabcf1df-5d48-4e4b-8491-288ad2dfd279-kube-api-access-cdnnl\" (UniqueName: \"kubernetes.io/projected/dabcf1df-5d48-4e4b-8491-288ad2dfd279-kube-api-access-cdnnl\") pod \"dabcf1df-5d48-4e4b-8491-288ad2dfd279\" (UID: \"dabcf1df-5d48-4e4b-8491-288ad2dfd279\") "
Nov 03 17:37:35.065950 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.065883    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dabcf1df-5d48-4e4b-8491-288ad2dfd279-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dabcf1df-5d48-4e4b-8491-288ad2dfd279-plugins-config-volume\") pod \"dabcf1df-5d48-4e4b-8491-288ad2dfd279\" (UID: \"dabcf1df-5d48-4e4b-8491-288ad2dfd279\") "
Nov 03 17:37:35.066337 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.066313    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dabcf1df-5d48-4e4b-8491-288ad2dfd279-plugins-config-volume" pod "dabcf1df-5d48-4e4b-8491-288ad2dfd279" (UID: "dabcf1df-5d48-4e4b-8491-288ad2dfd279"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:37:35.066491 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.066465    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6gv7\" (UniqueName: \"kubernetes.io/projected/cd9016e5-9676-4809-a81d-8f8aa1d08c8b-kube-api-access-k6gv7\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:37:35.066536 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.066502    5021 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dabcf1df-5d48-4e4b-8491-288ad2dfd279-plugins-config-volume\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:37:35.067983 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.067954    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dabcf1df-5d48-4e4b-8491-288ad2dfd279-kube-api-access-cdnnl" pod "dabcf1df-5d48-4e4b-8491-288ad2dfd279" (UID: "dabcf1df-5d48-4e4b-8491-288ad2dfd279"). InnerVolumeSpecName "kube-api-access-cdnnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:37:35.112653 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.112568    5021 patch_prober.go:29] interesting pod/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 03 17:37:35.112653 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.112621    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548" podUID="cf8a66ad-fe50-45f0-81ae-14cb438c3273" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 03 17:37:35.167797 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.167751    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdnnl\" (UniqueName: \"kubernetes.io/projected/dabcf1df-5d48-4e4b-8491-288ad2dfd279-kube-api-access-cdnnl\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:37:35.784507 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.784476    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"
Nov 03 17:37:35.785012 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.784511    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh" event={"ID":"cd9016e5-9676-4809-a81d-8f8aa1d08c8b","Type":"ContainerDied","Data":"d7a1a15d3ee123b47ebf076018d833a7cefef1c8eba47fa3e9a9ad79d44886cd"}
Nov 03 17:37:35.785012 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.784613    5021 scope.go:122] "RemoveContainer" containerID="22177679063c25d73cade5f78b73397cb964a120f5936f656fd1d06055a8d55e"
Nov 03 17:37:35.786178 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.786151    5021 generic.go:356] "Generic (PLEG): container finished" podID="dabcf1df-5d48-4e4b-8491-288ad2dfd279" containerID="0708edaf6cb5efaa39f0e828583a0554fd4f62fce75873423445851bb6d2b7fe" exitCode=0
Nov 03 17:37:35.787078 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.787061    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"
Nov 03 17:37:35.787342 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.787311    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg" event={"ID":"dabcf1df-5d48-4e4b-8491-288ad2dfd279","Type":"ContainerDied","Data":"0708edaf6cb5efaa39f0e828583a0554fd4f62fce75873423445851bb6d2b7fe"}
Nov 03 17:37:35.787405 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.787365    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg" event={"ID":"dabcf1df-5d48-4e4b-8491-288ad2dfd279","Type":"ContainerDied","Data":"8893c552e4a7fdaf070b1bdac780484170097187a21137087f958fa48815e902"}
Nov 03 17:37:35.796844 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.796828    5021 scope.go:122] "RemoveContainer" containerID="0708edaf6cb5efaa39f0e828583a0554fd4f62fce75873423445851bb6d2b7fe"
Nov 03 17:37:35.805848 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.805828    5021 scope.go:122] "RemoveContainer" containerID="0708edaf6cb5efaa39f0e828583a0554fd4f62fce75873423445851bb6d2b7fe"
Nov 03 17:37:35.806126 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:37:35.806109    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0708edaf6cb5efaa39f0e828583a0554fd4f62fce75873423445851bb6d2b7fe\": container with ID starting with 0708edaf6cb5efaa39f0e828583a0554fd4f62fce75873423445851bb6d2b7fe not found: ID does not exist" containerID="0708edaf6cb5efaa39f0e828583a0554fd4f62fce75873423445851bb6d2b7fe"
Nov 03 17:37:35.806183 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.806138    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0708edaf6cb5efaa39f0e828583a0554fd4f62fce75873423445851bb6d2b7fe"} err="failed to get container status \"0708edaf6cb5efaa39f0e828583a0554fd4f62fce75873423445851bb6d2b7fe\": rpc error: code = NotFound desc = could not find container \"0708edaf6cb5efaa39f0e828583a0554fd4f62fce75873423445851bb6d2b7fe\": container with ID starting with 0708edaf6cb5efaa39f0e828583a0554fd4f62fce75873423445851bb6d2b7fe not found: ID does not exist"
Nov 03 17:37:35.965344 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:35.965255    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"]
Nov 03 17:37:36.016877 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:36.016844    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3f1cf1-7795868985-ltqjh"]
Nov 03 17:37:36.112904 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:36.112873    5021 patch_prober.go:29] interesting pod/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 03 17:37:36.113084 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:36.112925    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548" podUID="cf8a66ad-fe50-45f0-81ae-14cb438c3273" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 03 17:37:36.152725 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:36.152688    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"]
Nov 03 17:37:36.155675 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:36.155651    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3f1cf1-668f9f88d7-645fg"]
Nov 03 17:37:37.069260 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:37:37.069204    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:37:37.112459 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:37.112427    5021 patch_prober.go:29] interesting pod/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 03 17:37:37.112628 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:37.112476    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548" podUID="cf8a66ad-fe50-45f0-81ae-14cb438c3273" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 03 17:37:38.003907 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:38.003868    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cd9016e5-9676-4809-a81d-8f8aa1d08c8b" path="/var/lib/kubelet/pods/cd9016e5-9676-4809-a81d-8f8aa1d08c8b/volumes"
Nov 03 17:37:38.004297 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:38.004282    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dabcf1df-5d48-4e4b-8491-288ad2dfd279" path="/var/lib/kubelet/pods/dabcf1df-5d48-4e4b-8491-288ad2dfd279/volumes"
Nov 03 17:37:38.112256 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:38.112213    5021 patch_prober.go:29] interesting pod/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 03 17:37:38.112683 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:38.112276    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548" podUID="cf8a66ad-fe50-45f0-81ae-14cb438c3273" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 03 17:37:39.111964 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:39.111932    5021 patch_prober.go:29] interesting pod/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 03 17:37:39.112127 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:39.111983    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548" podUID="cf8a66ad-fe50-45f0-81ae-14cb438c3273" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 03 17:37:40.116906 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:40.116878    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:40.117423 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:40.117353    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:40.118005 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:40.117988    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:37:47.053919 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.053884    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"]
Nov 03 17:37:47.054321 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.054072    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv" podUID="3b5d5fee-ac09-47ae-96de-64fefcf56c42" containerName="maas-api" containerID="cri-o://4889354a8f2debc54663ec79215a97c2c96a7387088c44ce5658b995b2f80b64" gracePeriod=30
Nov 03 17:37:47.328189 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.328158    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:37:47.432252 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.432200    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b5d5fee-ac09-47ae-96de-64fefcf56c42-kube-api-access-nkbl9\" (UniqueName: \"kubernetes.io/projected/3b5d5fee-ac09-47ae-96de-64fefcf56c42-kube-api-access-nkbl9\") pod \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\" (UID: \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\") "
Nov 03 17:37:47.432415 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.432290    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3b5d5fee-ac09-47ae-96de-64fefcf56c42-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5d5fee-ac09-47ae-96de-64fefcf56c42-metrics-certs\") pod \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\" (UID: \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\") "
Nov 03 17:37:47.432493 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.432477    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3b5d5fee-ac09-47ae-96de-64fefcf56c42-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b5d5fee-ac09-47ae-96de-64fefcf56c42-openshift-service-ca\") pod \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\" (UID: \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\") "
Nov 03 17:37:47.432580 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.432556    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3b5d5fee-ac09-47ae-96de-64fefcf56c42-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b5d5fee-ac09-47ae-96de-64fefcf56c42-maas-api-tls\") pod \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\" (UID: \"3b5d5fee-ac09-47ae-96de-64fefcf56c42\") "
Nov 03 17:37:47.432857 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.432831    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b5d5fee-ac09-47ae-96de-64fefcf56c42-openshift-service-ca" pod "3b5d5fee-ac09-47ae-96de-64fefcf56c42" (UID: "3b5d5fee-ac09-47ae-96de-64fefcf56c42"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:37:47.433080 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.433062    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b5d5fee-ac09-47ae-96de-64fefcf56c42-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:37:47.434446 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.434419    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b5d5fee-ac09-47ae-96de-64fefcf56c42-metrics-certs" pod "3b5d5fee-ac09-47ae-96de-64fefcf56c42" (UID: "3b5d5fee-ac09-47ae-96de-64fefcf56c42"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:37:47.434547 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.434453    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b5d5fee-ac09-47ae-96de-64fefcf56c42-kube-api-access-nkbl9" pod "3b5d5fee-ac09-47ae-96de-64fefcf56c42" (UID: "3b5d5fee-ac09-47ae-96de-64fefcf56c42"). InnerVolumeSpecName "kube-api-access-nkbl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:37:47.434591 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.434555    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b5d5fee-ac09-47ae-96de-64fefcf56c42-maas-api-tls" pod "3b5d5fee-ac09-47ae-96de-64fefcf56c42" (UID: "3b5d5fee-ac09-47ae-96de-64fefcf56c42"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:37:47.533900 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.533864    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkbl9\" (UniqueName: \"kubernetes.io/projected/3b5d5fee-ac09-47ae-96de-64fefcf56c42-kube-api-access-nkbl9\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:37:47.533900 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.533894    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5d5fee-ac09-47ae-96de-64fefcf56c42-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:37:47.533900 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.533905    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b5d5fee-ac09-47ae-96de-64fefcf56c42-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:37:47.884422 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.884375    5021 generic.go:356] "Generic (PLEG): container finished" podID="3b5d5fee-ac09-47ae-96de-64fefcf56c42" containerID="4889354a8f2debc54663ec79215a97c2c96a7387088c44ce5658b995b2f80b64" exitCode=0
Nov 03 17:37:47.884617 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.884431    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"
Nov 03 17:37:47.884617 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.884456    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv" event={"ID":"3b5d5fee-ac09-47ae-96de-64fefcf56c42","Type":"ContainerDied","Data":"4889354a8f2debc54663ec79215a97c2c96a7387088c44ce5658b995b2f80b64"}
Nov 03 17:37:47.884617 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.884512    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv" event={"ID":"3b5d5fee-ac09-47ae-96de-64fefcf56c42","Type":"ContainerDied","Data":"bc2590e2df4b4f960b32ca9eeff5a2003840b0a0953ed272719f28cabc6d1bf0"}
Nov 03 17:37:47.884617 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.884536    5021 scope.go:122] "RemoveContainer" containerID="4889354a8f2debc54663ec79215a97c2c96a7387088c44ce5658b995b2f80b64"
Nov 03 17:37:47.895958 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.895938    5021 scope.go:122] "RemoveContainer" containerID="4889354a8f2debc54663ec79215a97c2c96a7387088c44ce5658b995b2f80b64"
Nov 03 17:37:47.896277 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:37:47.896253    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4889354a8f2debc54663ec79215a97c2c96a7387088c44ce5658b995b2f80b64\": container with ID starting with 4889354a8f2debc54663ec79215a97c2c96a7387088c44ce5658b995b2f80b64 not found: ID does not exist" containerID="4889354a8f2debc54663ec79215a97c2c96a7387088c44ce5658b995b2f80b64"
Nov 03 17:37:47.896353 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:47.896285    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4889354a8f2debc54663ec79215a97c2c96a7387088c44ce5658b995b2f80b64"} err="failed to get container status \"4889354a8f2debc54663ec79215a97c2c96a7387088c44ce5658b995b2f80b64\": rpc error: code = NotFound desc = could not find container \"4889354a8f2debc54663ec79215a97c2c96a7387088c44ce5658b995b2f80b64\": container with ID starting with 4889354a8f2debc54663ec79215a97c2c96a7387088c44ce5658b995b2f80b64 not found: ID does not exist"
Nov 03 17:37:48.063519 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:48.063476    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"]
Nov 03 17:37:48.112826 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:48.112791    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3f1cf1-78bfd7f8fc-rqwhv"]
Nov 03 17:37:50.005097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:37:50.005054    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3b5d5fee-ac09-47ae-96de-64fefcf56c42" path="/var/lib/kubelet/pods/3b5d5fee-ac09-47ae-96de-64fefcf56c42/volumes"
Nov 03 17:38:07.051735 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:38:07.051675    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:38:28.890868 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:28.890781    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"]
Nov 03 17:38:28.891460 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:28.891029    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6" podUID="ddf156de-58e2-4c01-a74b-b46896c6ab42" containerName="maas-api" containerID="cri-o://a566d30ac96b20ef02795f96a3f3fc88d23b1f2c54539a586bb974341449c009" gracePeriod=30
Nov 03 17:38:29.172999 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.172973    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:38:29.305080 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.305042    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ddf156de-58e2-4c01-a74b-b46896c6ab42-kube-api-access-hlsrg\" (UniqueName: \"kubernetes.io/projected/ddf156de-58e2-4c01-a74b-b46896c6ab42-kube-api-access-hlsrg\") pod \"ddf156de-58e2-4c01-a74b-b46896c6ab42\" (UID: \"ddf156de-58e2-4c01-a74b-b46896c6ab42\") "
Nov 03 17:38:29.305280 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.305266    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ddf156de-58e2-4c01-a74b-b46896c6ab42-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddf156de-58e2-4c01-a74b-b46896c6ab42-maas-api-tls\") pod \"ddf156de-58e2-4c01-a74b-b46896c6ab42\" (UID: \"ddf156de-58e2-4c01-a74b-b46896c6ab42\") "
Nov 03 17:38:29.305329 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.305303    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ddf156de-58e2-4c01-a74b-b46896c6ab42-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddf156de-58e2-4c01-a74b-b46896c6ab42-openshift-service-ca\") pod \"ddf156de-58e2-4c01-a74b-b46896c6ab42\" (UID: \"ddf156de-58e2-4c01-a74b-b46896c6ab42\") "
Nov 03 17:38:29.305372 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.305325    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ddf156de-58e2-4c01-a74b-b46896c6ab42-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddf156de-58e2-4c01-a74b-b46896c6ab42-metrics-certs\") pod \"ddf156de-58e2-4c01-a74b-b46896c6ab42\" (UID: \"ddf156de-58e2-4c01-a74b-b46896c6ab42\") "
Nov 03 17:38:29.305723 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.305680    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddf156de-58e2-4c01-a74b-b46896c6ab42-openshift-service-ca" pod "ddf156de-58e2-4c01-a74b-b46896c6ab42" (UID: "ddf156de-58e2-4c01-a74b-b46896c6ab42"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:38:29.307852 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.307822    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddf156de-58e2-4c01-a74b-b46896c6ab42-maas-api-tls" pod "ddf156de-58e2-4c01-a74b-b46896c6ab42" (UID: "ddf156de-58e2-4c01-a74b-b46896c6ab42"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:38:29.307990 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.307874    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddf156de-58e2-4c01-a74b-b46896c6ab42-metrics-certs" pod "ddf156de-58e2-4c01-a74b-b46896c6ab42" (UID: "ddf156de-58e2-4c01-a74b-b46896c6ab42"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:38:29.308401 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.308358    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddf156de-58e2-4c01-a74b-b46896c6ab42-kube-api-access-hlsrg" pod "ddf156de-58e2-4c01-a74b-b46896c6ab42" (UID: "ddf156de-58e2-4c01-a74b-b46896c6ab42"). InnerVolumeSpecName "kube-api-access-hlsrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:38:29.357916 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.357887    5021 generic.go:356] "Generic (PLEG): container finished" podID="ddf156de-58e2-4c01-a74b-b46896c6ab42" containerID="a566d30ac96b20ef02795f96a3f3fc88d23b1f2c54539a586bb974341449c009" exitCode=0
Nov 03 17:38:29.358071 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.357933    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"
Nov 03 17:38:29.358071 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.357955    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6" event={"ID":"ddf156de-58e2-4c01-a74b-b46896c6ab42","Type":"ContainerDied","Data":"a566d30ac96b20ef02795f96a3f3fc88d23b1f2c54539a586bb974341449c009"}
Nov 03 17:38:29.358071 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.357996    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6" event={"ID":"ddf156de-58e2-4c01-a74b-b46896c6ab42","Type":"ContainerDied","Data":"28e8096f0c5835f34ae8ebe8714024fa67a092fa08b585ffdf0355abd6588546"}
Nov 03 17:38:29.358071 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.358017    5021 scope.go:122] "RemoveContainer" containerID="a566d30ac96b20ef02795f96a3f3fc88d23b1f2c54539a586bb974341449c009"
Nov 03 17:38:29.367961 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.367941    5021 scope.go:122] "RemoveContainer" containerID="a566d30ac96b20ef02795f96a3f3fc88d23b1f2c54539a586bb974341449c009"
Nov 03 17:38:29.368279 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:38:29.368255    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a566d30ac96b20ef02795f96a3f3fc88d23b1f2c54539a586bb974341449c009\": container with ID starting with a566d30ac96b20ef02795f96a3f3fc88d23b1f2c54539a586bb974341449c009 not found: ID does not exist" containerID="a566d30ac96b20ef02795f96a3f3fc88d23b1f2c54539a586bb974341449c009"
Nov 03 17:38:29.368333 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.368287    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a566d30ac96b20ef02795f96a3f3fc88d23b1f2c54539a586bb974341449c009"} err="failed to get container status \"a566d30ac96b20ef02795f96a3f3fc88d23b1f2c54539a586bb974341449c009\": rpc error: code = NotFound desc = could not find container \"a566d30ac96b20ef02795f96a3f3fc88d23b1f2c54539a586bb974341449c009\": container with ID starting with a566d30ac96b20ef02795f96a3f3fc88d23b1f2c54539a586bb974341449c009 not found: ID does not exist"
Nov 03 17:38:29.406660 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.406585    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddf156de-58e2-4c01-a74b-b46896c6ab42-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:38:29.406660 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.406624    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddf156de-58e2-4c01-a74b-b46896c6ab42-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:38:29.406660 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.406634    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddf156de-58e2-4c01-a74b-b46896c6ab42-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:38:29.406660 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.406644    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlsrg\" (UniqueName: \"kubernetes.io/projected/ddf156de-58e2-4c01-a74b-b46896c6ab42-kube-api-access-hlsrg\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:38:29.537678 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.537643    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"]
Nov 03 17:38:29.550546 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:29.550510    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e34dd2-686cf94c7b-ffhj6"]
Nov 03 17:38:30.004483 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:30.004450    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ddf156de-58e2-4c01-a74b-b46896c6ab42" path="/var/lib/kubelet/pods/ddf156de-58e2-4c01-a74b-b46896c6ab42/volumes"
Nov 03 17:38:37.047176 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:38:37.047138    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:38:47.419672 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:47.419632    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"]
Nov 03 17:38:47.420124 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:47.419874    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6" podUID="480f6089-e4b0-41a1-be62-83d1d44f0eb4" containerName="istio-proxy" containerID="cri-o://85602ed0d85c9c4d7edd8c44b49f6b8af3175a7264aaee353b0ecebf96d31e7b" gracePeriod=30
Nov 03 17:38:52.677564 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.677534    5021 generic.go:356] "Generic (PLEG): container finished" podID="480f6089-e4b0-41a1-be62-83d1d44f0eb4" containerID="85602ed0d85c9c4d7edd8c44b49f6b8af3175a7264aaee353b0ecebf96d31e7b" exitCode=0
Nov 03 17:38:52.677924 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.677609    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6" event={"ID":"480f6089-e4b0-41a1-be62-83d1d44f0eb4","Type":"ContainerDied","Data":"85602ed0d85c9c4d7edd8c44b49f6b8af3175a7264aaee353b0ecebf96d31e7b"}
Nov 03 17:38:52.677924 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.677673    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6" event={"ID":"480f6089-e4b0-41a1-be62-83d1d44f0eb4","Type":"ContainerDied","Data":"c339363bc6286373d75fa3eecfa35dafdef0d6f3f5c572b0da797766384e3093"}
Nov 03 17:38:52.677924 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.677696    5021 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c339363bc6286373d75fa3eecfa35dafdef0d6f3f5c572b0da797766384e3093"
Nov 03 17:38:52.693747 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.693697    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:38:52.811479 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.811445    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istiod-ca-cert\") pod \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") "
Nov 03 17:38:52.811651 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.811516    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-token\" (UniqueName: \"kubernetes.io/projected/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-token\") pod \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") "
Nov 03 17:38:52.811651 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.811566    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-credential-socket\") pod \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") "
Nov 03 17:38:52.811651 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.811607    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-workload-socket\") pod \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") "
Nov 03 17:38:52.811797 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.811690    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-data\") pod \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") "
Nov 03 17:38:52.811797 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.811717    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-envoy\") pod \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") "
Nov 03 17:38:52.811797 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.811741    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-podinfo\") pod \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") "
Nov 03 17:38:52.811797 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.811793    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/480f6089-e4b0-41a1-be62-83d1d44f0eb4-kube-api-access-kbl76\" (UniqueName: \"kubernetes.io/projected/480f6089-e4b0-41a1-be62-83d1d44f0eb4-kube-api-access-kbl76\") pod \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") "
Nov 03 17:38:52.812003 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.811850    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-workload-certs\") pod \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\" (UID: \"480f6089-e4b0-41a1-be62-83d1d44f0eb4\") "
Nov 03 17:38:52.812003 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.811895    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-credential-socket" pod "480f6089-e4b0-41a1-be62-83d1d44f0eb4" (UID: "480f6089-e4b0-41a1-be62-83d1d44f0eb4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:38:52.812103 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.811987    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-workload-socket" pod "480f6089-e4b0-41a1-be62-83d1d44f0eb4" (UID: "480f6089-e4b0-41a1-be62-83d1d44f0eb4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:38:52.812103 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.812029    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-data" pod "480f6089-e4b0-41a1-be62-83d1d44f0eb4" (UID: "480f6089-e4b0-41a1-be62-83d1d44f0eb4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:38:52.812214 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.812194    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-workload-certs" pod "480f6089-e4b0-41a1-be62-83d1d44f0eb4" (UID: "480f6089-e4b0-41a1-be62-83d1d44f0eb4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:38:52.812303 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.812277    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istiod-ca-cert" pod "480f6089-e4b0-41a1-be62-83d1d44f0eb4" (UID: "480f6089-e4b0-41a1-be62-83d1d44f0eb4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:38:52.812449 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.812426    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:38:52.812546 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.812454    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:38:52.812546 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.812470    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:38:52.812546 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.812484    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:38:52.812546 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.812499    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:38:52.813910 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.813879    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-envoy" pod "480f6089-e4b0-41a1-be62-83d1d44f0eb4" (UID: "480f6089-e4b0-41a1-be62-83d1d44f0eb4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:38:52.813910 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.813880    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-token" pod "480f6089-e4b0-41a1-be62-83d1d44f0eb4" (UID: "480f6089-e4b0-41a1-be62-83d1d44f0eb4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:38:52.814075 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.813981    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-podinfo" pod "480f6089-e4b0-41a1-be62-83d1d44f0eb4" (UID: "480f6089-e4b0-41a1-be62-83d1d44f0eb4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 17:38:52.814118 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.814083    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/480f6089-e4b0-41a1-be62-83d1d44f0eb4-kube-api-access-kbl76" pod "480f6089-e4b0-41a1-be62-83d1d44f0eb4" (UID: "480f6089-e4b0-41a1-be62-83d1d44f0eb4"). InnerVolumeSpecName "kube-api-access-kbl76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:38:52.913407 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.913366    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:38:52.913407 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.913400    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:38:52.913612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.913416    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbl76\" (UniqueName: \"kubernetes.io/projected/480f6089-e4b0-41a1-be62-83d1d44f0eb4-kube-api-access-kbl76\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:38:52.913612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:52.913430    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/480f6089-e4b0-41a1-be62-83d1d44f0eb4-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:38:53.694097 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:53.694059    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"
Nov 03 17:38:53.921393 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:53.921361    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"]
Nov 03 17:38:53.972158 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:53.972085    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-krxb6"]
Nov 03 17:38:54.011332 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:38:54.011299    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="480f6089-e4b0-41a1-be62-83d1d44f0eb4" path="/var/lib/kubelet/pods/480f6089-e4b0-41a1-be62-83d1d44f0eb4/volumes"
Nov 03 17:39:07.046509 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:39:07.046468    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:39:25.089259 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.089209    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"]
Nov 03 17:39:25.089858 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.089842    5021 cpu_manager.go:414] "containerMap: removing container" podUID="cd9016e5-9676-4809-a81d-8f8aa1d08c8b" containerName="payload-processing"
Nov 03 17:39:25.089904 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.089859    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cd9016e5-9676-4809-a81d-8f8aa1d08c8b" containerName="payload-processing"
Nov 03 17:39:25.089904 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.089883    5021 cpu_manager.go:414] "containerMap: removing container" podUID="480f6089-e4b0-41a1-be62-83d1d44f0eb4" containerName="istio-proxy"
Nov 03 17:39:25.089904 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.089888    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="480f6089-e4b0-41a1-be62-83d1d44f0eb4" containerName="istio-proxy"
Nov 03 17:39:25.089904 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.089898    5021 cpu_manager.go:414] "containerMap: removing container" podUID="ddf156de-58e2-4c01-a74b-b46896c6ab42" containerName="maas-api"
Nov 03 17:39:25.089904 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.089902    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ddf156de-58e2-4c01-a74b-b46896c6ab42" containerName="maas-api"
Nov 03 17:39:25.090058 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.089911    5021 cpu_manager.go:414] "containerMap: removing container" podUID="3b5d5fee-ac09-47ae-96de-64fefcf56c42" containerName="maas-api"
Nov 03 17:39:25.090058 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.089915    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b5d5fee-ac09-47ae-96de-64fefcf56c42" containerName="maas-api"
Nov 03 17:39:25.090058 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.089942    5021 cpu_manager.go:414] "containerMap: removing container" podUID="dabcf1df-5d48-4e4b-8491-288ad2dfd279" containerName="payload-pre-processing"
Nov 03 17:39:25.090058 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.089947    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dabcf1df-5d48-4e4b-8491-288ad2dfd279" containerName="payload-pre-processing"
Nov 03 17:39:25.090058 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.090049    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="480f6089-e4b0-41a1-be62-83d1d44f0eb4" containerName="istio-proxy"
Nov 03 17:39:25.090058 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.090059    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="ddf156de-58e2-4c01-a74b-b46896c6ab42" containerName="maas-api"
Nov 03 17:39:25.090266 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.090066    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b5d5fee-ac09-47ae-96de-64fefcf56c42" containerName="maas-api"
Nov 03 17:39:25.090266 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.090077    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="dabcf1df-5d48-4e4b-8491-288ad2dfd279" containerName="payload-pre-processing"
Nov 03 17:39:25.090266 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.090082    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="cd9016e5-9676-4809-a81d-8f8aa1d08c8b" containerName="payload-processing"
Nov 03 17:39:25.093781 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.093765    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:39:25.150293 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.150257    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"]
Nov 03 17:39:25.197622 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.197583    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-1ed607ea-serving-cert\""
Nov 03 17:39:25.225631 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.225594    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21bfa987-e17a-4472-8f4b-af1de7f057b2-metrics-certs\") pod \"maas-api-e2e-ait-1ed607ea-8684f996b7-895cz\" (UID: \"21bfa987-e17a-4472-8f4b-af1de7f057b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:39:25.225824 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.225802    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgj77\" (UniqueName: \"kubernetes.io/projected/21bfa987-e17a-4472-8f4b-af1de7f057b2-kube-api-access-tgj77\") pod \"maas-api-e2e-ait-1ed607ea-8684f996b7-895cz\" (UID: \"21bfa987-e17a-4472-8f4b-af1de7f057b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:39:25.225936 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.225917    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21bfa987-e17a-4472-8f4b-af1de7f057b2-maas-api-tls\") pod \"maas-api-e2e-ait-1ed607ea-8684f996b7-895cz\" (UID: \"21bfa987-e17a-4472-8f4b-af1de7f057b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:39:25.226003 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.225949    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21bfa987-e17a-4472-8f4b-af1de7f057b2-openshift-service-ca\") pod \"maas-api-e2e-ait-1ed607ea-8684f996b7-895cz\" (UID: \"21bfa987-e17a-4472-8f4b-af1de7f057b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:39:25.327569 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.327534    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgj77\" (UniqueName: \"kubernetes.io/projected/21bfa987-e17a-4472-8f4b-af1de7f057b2-kube-api-access-tgj77\") pod \"maas-api-e2e-ait-1ed607ea-8684f996b7-895cz\" (UID: \"21bfa987-e17a-4472-8f4b-af1de7f057b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:39:25.327938 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.327896    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21bfa987-e17a-4472-8f4b-af1de7f057b2-maas-api-tls\") pod \"maas-api-e2e-ait-1ed607ea-8684f996b7-895cz\" (UID: \"21bfa987-e17a-4472-8f4b-af1de7f057b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:39:25.328060 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.327954    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21bfa987-e17a-4472-8f4b-af1de7f057b2-openshift-service-ca\") pod \"maas-api-e2e-ait-1ed607ea-8684f996b7-895cz\" (UID: \"21bfa987-e17a-4472-8f4b-af1de7f057b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:39:25.328060 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:39:25.328005    5021 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-serving-cert: secret "maas-api-e2e-ait-1ed607ea-serving-cert" not found
Nov 03 17:39:25.328180 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.328056    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21bfa987-e17a-4472-8f4b-af1de7f057b2-metrics-certs\") pod \"maas-api-e2e-ait-1ed607ea-8684f996b7-895cz\" (UID: \"21bfa987-e17a-4472-8f4b-af1de7f057b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:39:25.328180 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:39:25.328103    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21bfa987-e17a-4472-8f4b-af1de7f057b2-maas-api-tls podName:21bfa987-e17a-4472-8f4b-af1de7f057b2 nodeName:}" failed. No retries permitted until 2026-11-03 17:39:25.828083276 +0000 UTC m=+1366.029421311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/21bfa987-e17a-4472-8f4b-af1de7f057b2-maas-api-tls") pod "maas-api-e2e-ait-1ed607ea-8684f996b7-895cz" (UID: "21bfa987-e17a-4472-8f4b-af1de7f057b2") : secret "maas-api-e2e-ait-1ed607ea-serving-cert" not found
Nov 03 17:39:25.329208 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.329180    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21bfa987-e17a-4472-8f4b-af1de7f057b2-openshift-service-ca\") pod \"maas-api-e2e-ait-1ed607ea-8684f996b7-895cz\" (UID: \"21bfa987-e17a-4472-8f4b-af1de7f057b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:39:25.334034 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.334009    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21bfa987-e17a-4472-8f4b-af1de7f057b2-metrics-certs\") pod \"maas-api-e2e-ait-1ed607ea-8684f996b7-895cz\" (UID: \"21bfa987-e17a-4472-8f4b-af1de7f057b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:39:25.393490 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.393415    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgj77\" (UniqueName: \"kubernetes.io/projected/21bfa987-e17a-4472-8f4b-af1de7f057b2-kube-api-access-tgj77\") pod \"maas-api-e2e-ait-1ed607ea-8684f996b7-895cz\" (UID: \"21bfa987-e17a-4472-8f4b-af1de7f057b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:39:25.834685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.834647    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21bfa987-e17a-4472-8f4b-af1de7f057b2-maas-api-tls\") pod \"maas-api-e2e-ait-1ed607ea-8684f996b7-895cz\" (UID: \"21bfa987-e17a-4472-8f4b-af1de7f057b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:39:25.837116 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:25.837086    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21bfa987-e17a-4472-8f4b-af1de7f057b2-maas-api-tls\") pod \"maas-api-e2e-ait-1ed607ea-8684f996b7-895cz\" (UID: \"21bfa987-e17a-4472-8f4b-af1de7f057b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:39:26.008078 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:26.008048    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:39:26.393619 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:26.393592    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"]
Nov 03 17:39:26.394787 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:39:26.394763    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21bfa987_e17a_4472_8f4b_af1de7f057b2.slice/crio-5e6ff78018cde325b8bb8323316d4b16346b28c3a348569cd2d78313e8d12390 WatchSource:0}: Error finding container 5e6ff78018cde325b8bb8323316d4b16346b28c3a348569cd2d78313e8d12390: Status 404 returned error can't find the container with id 5e6ff78018cde325b8bb8323316d4b16346b28c3a348569cd2d78313e8d12390
Nov 03 17:39:26.396513 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:26.396494    5021 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 17:39:26.984682 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:26.984636    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz" event={"ID":"21bfa987-e17a-4472-8f4b-af1de7f057b2","Type":"ContainerStarted","Data":"5e6ff78018cde325b8bb8323316d4b16346b28c3a348569cd2d78313e8d12390"}
Nov 03 17:39:27.992939 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:27.992888    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz" event={"ID":"21bfa987-e17a-4472-8f4b-af1de7f057b2","Type":"ContainerStarted","Data":"3879a4a9b4381c081e671a8b418f9f86aaa7b702c046e4c50e4e413649a4a3ef"}
Nov 03 17:39:27.993379 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:27.993000    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:39:28.117331 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:28.117269    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz" podStartSLOduration=2.223529174 podStartE2EDuration="3.117253078s" totalImagesPullingTime="893.723904ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:39:28.11378053 +0000 UTC m=+1368.315118587" watchObservedRunningTime="2026-11-03 17:39:28.117253078 +0000 UTC m=+1368.318591130"
Nov 03 17:39:32.328394 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:32.328347    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 17:39:32.329111 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:32.329055    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq" podUID="5a1ddb65-ca04-4826-afaa-ab3e271011f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 17:39:32.540418 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:32.540367    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4" podUID="f7b69cb9-f649-4675-bf94-4633697601c5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 17:39:34.005329 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:34.005296    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:39:37.047088 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:39:37.047040    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:39:40.404010 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:40.403975    5021 scope.go:122] "RemoveContainer" containerID="85602ed0d85c9c4d7edd8c44b49f6b8af3175a7264aaee353b0ecebf96d31e7b"
Nov 03 17:39:49.541921 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:49.541824    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"]
Nov 03 17:39:49.548770 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:49.548745    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"
Nov 03 17:39:49.599941 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:49.599907    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"]
Nov 03 17:39:49.647541 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:49.647503    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-49c123d1-dockercfg-8c6mw\""
Nov 03 17:39:49.647541 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:49.647526    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-49c123d1\""
Nov 03 17:39:49.702822 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:49.702718    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s9x8\" (UniqueName: \"kubernetes.io/projected/de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b-kube-api-access-6s9x8\") pod \"payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk\" (UID: \"de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"
Nov 03 17:39:49.703161 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:49.703135    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk\" (UID: \"de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"
Nov 03 17:39:49.805026 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:49.804938    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s9x8\" (UniqueName: \"kubernetes.io/projected/de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b-kube-api-access-6s9x8\") pod \"payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk\" (UID: \"de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"
Nov 03 17:39:49.805365 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:49.805336    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk\" (UID: \"de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"
Nov 03 17:39:49.806632 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:49.806603    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk\" (UID: \"de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"
Nov 03 17:39:49.871955 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:49.871923    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s9x8\" (UniqueName: \"kubernetes.io/projected/de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b-kube-api-access-6s9x8\") pod \"payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk\" (UID: \"de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"
Nov 03 17:39:50.165703 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:50.165541    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"
Nov 03 17:39:51.004416 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:51.004369    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"]
Nov 03 17:39:51.312597 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:51.312560    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk" event={"ID":"de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b","Type":"ContainerStarted","Data":"1b896bdee365bfdd7a89d8d3748d0806e26dcfdceb0f2da00eb6c159db792d17"}
Nov 03 17:39:51.312782 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:51.312613    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk" event={"ID":"de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b","Type":"ContainerStarted","Data":"4780ee0742254f5136c635cbee2240545e5bd0f4c7f28589d8a6ea574dd9bddd"}
Nov 03 17:39:51.313601 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:51.313566    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"
Nov 03 17:39:51.442251 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:39:51.442003    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk" podStartSLOduration=2.441969635 podStartE2EDuration="2.441969635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:39:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:39:51.440775575 +0000 UTC m=+1391.642113627" watchObservedRunningTime="2026-11-03 17:39:51.441969635 +0000 UTC m=+1391.643307688"
Nov 03 17:40:03.329030 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:03.328995    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"
Nov 03 17:40:07.046021 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:40:07.045979    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:40:23.205627 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:23.205583    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"]
Nov 03 17:40:23.211381 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:23.211355    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:40:23.265877 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:23.265840    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"]
Nov 03 17:40:23.312589 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:23.312559    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-49c123d1-serving-cert\""
Nov 03 17:40:23.328885 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:23.328840    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rlbp\" (UniqueName: \"kubernetes.io/projected/e62c266b-f033-413e-a8c2-a634c5a6c14d-kube-api-access-8rlbp\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-72kvg\" (UID: \"e62c266b-f033-413e-a8c2-a634c5a6c14d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:40:23.329071 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:23.328914    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e62c266b-f033-413e-a8c2-a634c5a6c14d-maas-api-tls\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-72kvg\" (UID: \"e62c266b-f033-413e-a8c2-a634c5a6c14d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:40:23.329071 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:23.329031    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e62c266b-f033-413e-a8c2-a634c5a6c14d-metrics-certs\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-72kvg\" (UID: \"e62c266b-f033-413e-a8c2-a634c5a6c14d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:40:23.329221 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:23.329203    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e62c266b-f033-413e-a8c2-a634c5a6c14d-openshift-service-ca\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-72kvg\" (UID: \"e62c266b-f033-413e-a8c2-a634c5a6c14d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:40:23.430509 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:23.430474    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e62c266b-f033-413e-a8c2-a634c5a6c14d-openshift-service-ca\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-72kvg\" (UID: \"e62c266b-f033-413e-a8c2-a634c5a6c14d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:40:23.430874 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:23.430843    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rlbp\" (UniqueName: \"kubernetes.io/projected/e62c266b-f033-413e-a8c2-a634c5a6c14d-kube-api-access-8rlbp\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-72kvg\" (UID: \"e62c266b-f033-413e-a8c2-a634c5a6c14d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:40:23.431352 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:23.430911    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e62c266b-f033-413e-a8c2-a634c5a6c14d-maas-api-tls\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-72kvg\" (UID: \"e62c266b-f033-413e-a8c2-a634c5a6c14d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:40:23.431352 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:23.430956    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e62c266b-f033-413e-a8c2-a634c5a6c14d-metrics-certs\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-72kvg\" (UID: \"e62c266b-f033-413e-a8c2-a634c5a6c14d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:40:23.431501 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:40:23.431427    5021 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-serving-cert: secret "maas-api-e2e-mt-49c123d1-serving-cert" not found
Nov 03 17:40:23.431811 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:40:23.431741    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e62c266b-f033-413e-a8c2-a634c5a6c14d-maas-api-tls podName:e62c266b-f033-413e-a8c2-a634c5a6c14d nodeName:}" failed. No retries permitted until 2026-11-03 17:40:23.931482514 +0000 UTC m=+1424.132820546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e62c266b-f033-413e-a8c2-a634c5a6c14d-maas-api-tls") pod "maas-api-e2e-mt-49c123d1-85fb5898db-72kvg" (UID: "e62c266b-f033-413e-a8c2-a634c5a6c14d") : secret "maas-api-e2e-mt-49c123d1-serving-cert" not found
Nov 03 17:40:23.433011 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:23.432983    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e62c266b-f033-413e-a8c2-a634c5a6c14d-openshift-service-ca\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-72kvg\" (UID: \"e62c266b-f033-413e-a8c2-a634c5a6c14d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:40:23.435972 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:23.435922    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e62c266b-f033-413e-a8c2-a634c5a6c14d-metrics-certs\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-72kvg\" (UID: \"e62c266b-f033-413e-a8c2-a634c5a6c14d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:40:23.497811 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:23.497739    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rlbp\" (UniqueName: \"kubernetes.io/projected/e62c266b-f033-413e-a8c2-a634c5a6c14d-kube-api-access-8rlbp\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-72kvg\" (UID: \"e62c266b-f033-413e-a8c2-a634c5a6c14d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:40:23.937754 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:23.937718    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e62c266b-f033-413e-a8c2-a634c5a6c14d-maas-api-tls\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-72kvg\" (UID: \"e62c266b-f033-413e-a8c2-a634c5a6c14d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:40:23.940108 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:23.940085    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e62c266b-f033-413e-a8c2-a634c5a6c14d-maas-api-tls\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-72kvg\" (UID: \"e62c266b-f033-413e-a8c2-a634c5a6c14d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:40:24.127442 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:24.127403    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:40:24.514153 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:40:24.514121    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode62c266b_f033_413e_a8c2_a634c5a6c14d.slice/crio-f27f1672b8d22d81abfa2c56db4f149898447125140e560c8ba32a18eff5345f WatchSource:0}: Error finding container f27f1672b8d22d81abfa2c56db4f149898447125140e560c8ba32a18eff5345f: Status 404 returned error can't find the container with id f27f1672b8d22d81abfa2c56db4f149898447125140e560c8ba32a18eff5345f
Nov 03 17:40:24.514594 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:24.514262    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"]
Nov 03 17:40:24.583879 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:24.583846    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg" event={"ID":"e62c266b-f033-413e-a8c2-a634c5a6c14d","Type":"ContainerStarted","Data":"f27f1672b8d22d81abfa2c56db4f149898447125140e560c8ba32a18eff5345f"}
Nov 03 17:40:25.591357 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:25.591317    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg" event={"ID":"e62c266b-f033-413e-a8c2-a634c5a6c14d","Type":"ContainerStarted","Data":"a959b3cd77e90480d50d6c46f8ccdc5ae16e546f4cb29318ad3256d5808c3a35"}
Nov 03 17:40:25.591817 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:25.591413    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:40:25.715294 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:25.715163    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg" podStartSLOduration=1.885424404 podStartE2EDuration="2.715148641s" totalImagesPullingTime="829.724237ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:40:25.713284254 +0000 UTC m=+1425.914622306" watchObservedRunningTime="2026-11-03 17:40:25.715148641 +0000 UTC m=+1425.916486692"
Nov 03 17:40:31.604173 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:31.604132    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:40:37.046019 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:40:37.045980    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:40:46.099004 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.098968    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"]
Nov 03 17:40:46.099711 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.099166    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz" podUID="21bfa987-e17a-4472-8f4b-af1de7f057b2" containerName="maas-api" containerID="cri-o://3879a4a9b4381c081e671a8b418f9f86aaa7b702c046e4c50e4e413649a4a3ef" gracePeriod=30
Nov 03 17:40:46.381277 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.381245    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:40:46.532215 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.532176    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/21bfa987-e17a-4472-8f4b-af1de7f057b2-kube-api-access-tgj77\" (UniqueName: \"kubernetes.io/projected/21bfa987-e17a-4472-8f4b-af1de7f057b2-kube-api-access-tgj77\") pod \"21bfa987-e17a-4472-8f4b-af1de7f057b2\" (UID: \"21bfa987-e17a-4472-8f4b-af1de7f057b2\") "
Nov 03 17:40:46.532427 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.532362    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/21bfa987-e17a-4472-8f4b-af1de7f057b2-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21bfa987-e17a-4472-8f4b-af1de7f057b2-openshift-service-ca\") pod \"21bfa987-e17a-4472-8f4b-af1de7f057b2\" (UID: \"21bfa987-e17a-4472-8f4b-af1de7f057b2\") "
Nov 03 17:40:46.532427 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.532414    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/21bfa987-e17a-4472-8f4b-af1de7f057b2-metrics-certs\" (UniqueName: \"kubernetes.io/secret/21bfa987-e17a-4472-8f4b-af1de7f057b2-metrics-certs\") pod \"21bfa987-e17a-4472-8f4b-af1de7f057b2\" (UID: \"21bfa987-e17a-4472-8f4b-af1de7f057b2\") "
Nov 03 17:40:46.532553 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.532536    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/21bfa987-e17a-4472-8f4b-af1de7f057b2-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21bfa987-e17a-4472-8f4b-af1de7f057b2-maas-api-tls\") pod \"21bfa987-e17a-4472-8f4b-af1de7f057b2\" (UID: \"21bfa987-e17a-4472-8f4b-af1de7f057b2\") "
Nov 03 17:40:46.532785 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.532758    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21bfa987-e17a-4472-8f4b-af1de7f057b2-openshift-service-ca" pod "21bfa987-e17a-4472-8f4b-af1de7f057b2" (UID: "21bfa987-e17a-4472-8f4b-af1de7f057b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:40:46.533168 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.533144    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21bfa987-e17a-4472-8f4b-af1de7f057b2-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:40:46.534545 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.534518    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21bfa987-e17a-4472-8f4b-af1de7f057b2-kube-api-access-tgj77" pod "21bfa987-e17a-4472-8f4b-af1de7f057b2" (UID: "21bfa987-e17a-4472-8f4b-af1de7f057b2"). InnerVolumeSpecName "kube-api-access-tgj77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:40:46.534853 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.534833    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21bfa987-e17a-4472-8f4b-af1de7f057b2-metrics-certs" pod "21bfa987-e17a-4472-8f4b-af1de7f057b2" (UID: "21bfa987-e17a-4472-8f4b-af1de7f057b2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:40:46.535299 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.535270    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21bfa987-e17a-4472-8f4b-af1de7f057b2-maas-api-tls" pod "21bfa987-e17a-4472-8f4b-af1de7f057b2" (UID: "21bfa987-e17a-4472-8f4b-af1de7f057b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:40:46.634896 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.634790    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21bfa987-e17a-4472-8f4b-af1de7f057b2-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:40:46.634896 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.634830    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21bfa987-e17a-4472-8f4b-af1de7f057b2-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:40:46.634896 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.634846    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgj77\" (UniqueName: \"kubernetes.io/projected/21bfa987-e17a-4472-8f4b-af1de7f057b2-kube-api-access-tgj77\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:40:46.823843 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.823804    5021 generic.go:356] "Generic (PLEG): container finished" podID="21bfa987-e17a-4472-8f4b-af1de7f057b2" containerID="3879a4a9b4381c081e671a8b418f9f86aaa7b702c046e4c50e4e413649a4a3ef" exitCode=0
Nov 03 17:40:46.824009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.823854    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"
Nov 03 17:40:46.824009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.823885    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz" event={"ID":"21bfa987-e17a-4472-8f4b-af1de7f057b2","Type":"ContainerDied","Data":"3879a4a9b4381c081e671a8b418f9f86aaa7b702c046e4c50e4e413649a4a3ef"}
Nov 03 17:40:46.824009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.823946    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz" event={"ID":"21bfa987-e17a-4472-8f4b-af1de7f057b2","Type":"ContainerDied","Data":"5e6ff78018cde325b8bb8323316d4b16346b28c3a348569cd2d78313e8d12390"}
Nov 03 17:40:46.824009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.823969    5021 scope.go:122] "RemoveContainer" containerID="3879a4a9b4381c081e671a8b418f9f86aaa7b702c046e4c50e4e413649a4a3ef"
Nov 03 17:40:46.835177 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.835157    5021 scope.go:122] "RemoveContainer" containerID="3879a4a9b4381c081e671a8b418f9f86aaa7b702c046e4c50e4e413649a4a3ef"
Nov 03 17:40:46.835472 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:40:46.835452    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3879a4a9b4381c081e671a8b418f9f86aaa7b702c046e4c50e4e413649a4a3ef\": container with ID starting with 3879a4a9b4381c081e671a8b418f9f86aaa7b702c046e4c50e4e413649a4a3ef not found: ID does not exist" containerID="3879a4a9b4381c081e671a8b418f9f86aaa7b702c046e4c50e4e413649a4a3ef"
Nov 03 17:40:46.835516 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.835480    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3879a4a9b4381c081e671a8b418f9f86aaa7b702c046e4c50e4e413649a4a3ef"} err="failed to get container status \"3879a4a9b4381c081e671a8b418f9f86aaa7b702c046e4c50e4e413649a4a3ef\": rpc error: code = NotFound desc = could not find container \"3879a4a9b4381c081e671a8b418f9f86aaa7b702c046e4c50e4e413649a4a3ef\": container with ID starting with 3879a4a9b4381c081e671a8b418f9f86aaa7b702c046e4c50e4e413649a4a3ef not found: ID does not exist"
Nov 03 17:40:46.996609 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:46.996518    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"]
Nov 03 17:40:47.002121 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:47.002094    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ed607ea-8684f996b7-895cz"]
Nov 03 17:40:48.004080 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:40:48.004041    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="21bfa987-e17a-4472-8f4b-af1de7f057b2" path="/var/lib/kubelet/pods/21bfa987-e17a-4472-8f4b-af1de7f057b2/volumes"
Nov 03 17:41:07.046339 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:41:07.046300    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:41:18.634754 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.634716    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"]
Nov 03 17:41:18.643486 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.635330    5021 cpu_manager.go:414] "containerMap: removing container" podUID="21bfa987-e17a-4472-8f4b-af1de7f057b2" containerName="maas-api"
Nov 03 17:41:18.643486 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.635346    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="21bfa987-e17a-4472-8f4b-af1de7f057b2" containerName="maas-api"
Nov 03 17:41:18.643486 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.635463    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="21bfa987-e17a-4472-8f4b-af1de7f057b2" containerName="maas-api"
Nov 03 17:41:18.647717 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.647688    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.757689 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.757659    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"]
Nov 03 17:41:18.803817 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.803777    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ec638e1-c16b-4853-9079-7de44f5d4070-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.804032 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.803855    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.804032 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.803981    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.804161 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.804103    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.804161 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.804142    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.804290 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.804180    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.804290 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.804214    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.804397 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.804332    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.804397 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.804361    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqcpq\" (UniqueName: \"kubernetes.io/projected/0ec638e1-c16b-4853-9079-7de44f5d4070-kube-api-access-bqcpq\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.905311 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.905206    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.905311 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.905261    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.905311 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.905289    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.905604 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.905328    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.905604 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.905402    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.905604 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.905429    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqcpq\" (UniqueName: \"kubernetes.io/projected/0ec638e1-c16b-4853-9079-7de44f5d4070-kube-api-access-bqcpq\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.905604 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.905493    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ec638e1-c16b-4853-9079-7de44f5d4070-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.905604 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.905547    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.905604 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.905588    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.905910 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.905726    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.905910 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.905752    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.905910 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.905821    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.906075 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.905993    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.906699 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.906675    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ec638e1-c16b-4853-9079-7de44f5d4070-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.907962 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.907942    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.908206 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.908181    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.969895 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.969856    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqcpq\" (UniqueName: \"kubernetes.io/projected/0ec638e1-c16b-4853-9079-7de44f5d4070-kube-api-access-bqcpq\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:18.973661 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:18.973629    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-7ctxx\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:19.263131 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:19.263096    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:19.701221 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:19.701140    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"]
Nov 03 17:41:19.738100 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:41:19.738064    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec638e1_c16b_4853_9079_7de44f5d4070.slice/crio-ad17fb3805be23ef16c5e2577f7b0be4e5b58b1f26ad2e57bc3707dde4245568 WatchSource:0}: Error finding container ad17fb3805be23ef16c5e2577f7b0be4e5b58b1f26ad2e57bc3707dde4245568: Status 404 returned error can't find the container with id ad17fb3805be23ef16c5e2577f7b0be4e5b58b1f26ad2e57bc3707dde4245568
Nov 03 17:41:19.740844 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:19.740807    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:41:19.740953 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:19.740895    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:41:19.740953 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:19.740942    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:41:20.064868 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:20.062022    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx" event={"ID":"0ec638e1-c16b-4853-9079-7de44f5d4070","Type":"ContainerStarted","Data":"ac36b14e6b12774bc22ab3152aa8e9506032050a2b56bb3266424ffa4c19a0d7"}
Nov 03 17:41:20.064868 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:20.062104    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx" event={"ID":"0ec638e1-c16b-4853-9079-7de44f5d4070","Type":"ContainerStarted","Data":"ad17fb3805be23ef16c5e2577f7b0be4e5b58b1f26ad2e57bc3707dde4245568"}
Nov 03 17:41:20.190419 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:20.190357    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx" podStartSLOduration=2.190338995 podStartE2EDuration="2.190338995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:41:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:41:20.187019919 +0000 UTC m=+1480.388357974" watchObservedRunningTime="2026-11-03 17:41:20.190338995 +0000 UTC m=+1480.391677047"
Nov 03 17:41:20.263380 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:20.263298    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:20.265760 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:20.265727    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ctxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Nov 03 17:41:20.265920 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:20.265787    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx" podUID="0ec638e1-c16b-4853-9079-7de44f5d4070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Nov 03 17:41:21.263907 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:21.263868    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ctxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Nov 03 17:41:21.264326 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:21.263936    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx" podUID="0ec638e1-c16b-4853-9079-7de44f5d4070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Nov 03 17:41:22.263824 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:22.263779    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ctxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Nov 03 17:41:22.264014 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:22.263856    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx" podUID="0ec638e1-c16b-4853-9079-7de44f5d4070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Nov 03 17:41:23.264409 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:23.264373    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ctxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Nov 03 17:41:23.264810 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:23.264427    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx" podUID="0ec638e1-c16b-4853-9079-7de44f5d4070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Nov 03 17:41:24.263841 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:24.263798    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ctxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Nov 03 17:41:24.264003 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:24.263860    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx" podUID="0ec638e1-c16b-4853-9079-7de44f5d4070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Nov 03 17:41:25.263984 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:25.263946    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ctxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Nov 03 17:41:25.264415 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:25.264001    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx" podUID="0ec638e1-c16b-4853-9079-7de44f5d4070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Nov 03 17:41:26.264092 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:26.264056    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ctxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Nov 03 17:41:26.264514 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:26.264111    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx" podUID="0ec638e1-c16b-4853-9079-7de44f5d4070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Nov 03 17:41:27.264479 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:27.264443    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ctxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Nov 03 17:41:27.264903 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:27.264497    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx" podUID="0ec638e1-c16b-4853-9079-7de44f5d4070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Nov 03 17:41:29.305434 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:29.305383    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ctxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 17:41:29.305976 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:29.305472    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx" podUID="0ec638e1-c16b-4853-9079-7de44f5d4070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 17:41:29.355054 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:29.355011    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:29.355516 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:29.355487    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:29.356316 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:29.356295    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:41:31.578919 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:31.578878    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"]
Nov 03 17:41:31.584262 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:31.584238    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:41:31.637710 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:31.637674    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"]
Nov 03 17:41:31.685797 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:31.685762    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-5f88f673-serving-cert\""
Nov 03 17:41:31.688628 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:31.688595    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb85fab8-d811-4572-a0cc-bbb927deac81-openshift-service-ca\") pod \"maas-api-e2e-migrate-5f88f673-77f64649b-clpgm\" (UID: \"bb85fab8-d811-4572-a0cc-bbb927deac81\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:41:31.688778 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:31.688753    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb85fab8-d811-4572-a0cc-bbb927deac81-maas-api-tls\") pod \"maas-api-e2e-migrate-5f88f673-77f64649b-clpgm\" (UID: \"bb85fab8-d811-4572-a0cc-bbb927deac81\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:41:31.688919 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:31.688899    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb85fab8-d811-4572-a0cc-bbb927deac81-metrics-certs\") pod \"maas-api-e2e-migrate-5f88f673-77f64649b-clpgm\" (UID: \"bb85fab8-d811-4572-a0cc-bbb927deac81\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:41:31.688986 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:31.688955    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzpdg\" (UniqueName: \"kubernetes.io/projected/bb85fab8-d811-4572-a0cc-bbb927deac81-kube-api-access-bzpdg\") pod \"maas-api-e2e-migrate-5f88f673-77f64649b-clpgm\" (UID: \"bb85fab8-d811-4572-a0cc-bbb927deac81\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:41:31.791133 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:31.791092    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzpdg\" (UniqueName: \"kubernetes.io/projected/bb85fab8-d811-4572-a0cc-bbb927deac81-kube-api-access-bzpdg\") pod \"maas-api-e2e-migrate-5f88f673-77f64649b-clpgm\" (UID: \"bb85fab8-d811-4572-a0cc-bbb927deac81\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:41:31.791506 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:31.791486    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb85fab8-d811-4572-a0cc-bbb927deac81-openshift-service-ca\") pod \"maas-api-e2e-migrate-5f88f673-77f64649b-clpgm\" (UID: \"bb85fab8-d811-4572-a0cc-bbb927deac81\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:41:31.791690 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:31.791675    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb85fab8-d811-4572-a0cc-bbb927deac81-maas-api-tls\") pod \"maas-api-e2e-migrate-5f88f673-77f64649b-clpgm\" (UID: \"bb85fab8-d811-4572-a0cc-bbb927deac81\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:41:31.791869 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:31.791846    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb85fab8-d811-4572-a0cc-bbb927deac81-metrics-certs\") pod \"maas-api-e2e-migrate-5f88f673-77f64649b-clpgm\" (UID: \"bb85fab8-d811-4572-a0cc-bbb927deac81\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:41:31.793032 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:31.793004    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb85fab8-d811-4572-a0cc-bbb927deac81-openshift-service-ca\") pod \"maas-api-e2e-migrate-5f88f673-77f64649b-clpgm\" (UID: \"bb85fab8-d811-4572-a0cc-bbb927deac81\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:41:31.793728 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:41:31.793300    5021 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-serving-cert: secret "maas-api-e2e-migrate-5f88f673-serving-cert" not found
Nov 03 17:41:31.793959 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:41:31.793940    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb85fab8-d811-4572-a0cc-bbb927deac81-maas-api-tls podName:bb85fab8-d811-4572-a0cc-bbb927deac81 nodeName:}" failed. No retries permitted until 2026-11-03 17:41:32.293914998 +0000 UTC m=+1492.495253030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bb85fab8-d811-4572-a0cc-bbb927deac81-maas-api-tls") pod "maas-api-e2e-migrate-5f88f673-77f64649b-clpgm" (UID: "bb85fab8-d811-4572-a0cc-bbb927deac81") : secret "maas-api-e2e-migrate-5f88f673-serving-cert" not found
Nov 03 17:41:31.800806 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:31.800780    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb85fab8-d811-4572-a0cc-bbb927deac81-metrics-certs\") pod \"maas-api-e2e-migrate-5f88f673-77f64649b-clpgm\" (UID: \"bb85fab8-d811-4572-a0cc-bbb927deac81\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:41:31.868160 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:31.868081    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzpdg\" (UniqueName: \"kubernetes.io/projected/bb85fab8-d811-4572-a0cc-bbb927deac81-kube-api-access-bzpdg\") pod \"maas-api-e2e-migrate-5f88f673-77f64649b-clpgm\" (UID: \"bb85fab8-d811-4572-a0cc-bbb927deac81\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:41:32.307664 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:32.307620    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb85fab8-d811-4572-a0cc-bbb927deac81-maas-api-tls\") pod \"maas-api-e2e-migrate-5f88f673-77f64649b-clpgm\" (UID: \"bb85fab8-d811-4572-a0cc-bbb927deac81\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:41:32.310452 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:32.310417    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb85fab8-d811-4572-a0cc-bbb927deac81-maas-api-tls\") pod \"maas-api-e2e-migrate-5f88f673-77f64649b-clpgm\" (UID: \"bb85fab8-d811-4572-a0cc-bbb927deac81\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:41:32.498953 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:32.498902    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:41:32.911125 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:41:32.911084    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb85fab8_d811_4572_a0cc_bbb927deac81.slice/crio-039c731a196c12514d167cc7e3c74cff081565d120e0aa9a520fe955359e27d6 WatchSource:0}: Error finding container 039c731a196c12514d167cc7e3c74cff081565d120e0aa9a520fe955359e27d6: Status 404 returned error can't find the container with id 039c731a196c12514d167cc7e3c74cff081565d120e0aa9a520fe955359e27d6
Nov 03 17:41:32.912544 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:32.912517    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"]
Nov 03 17:41:33.185901 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:33.185750    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm" event={"ID":"bb85fab8-d811-4572-a0cc-bbb927deac81","Type":"ContainerStarted","Data":"039c731a196c12514d167cc7e3c74cff081565d120e0aa9a520fe955359e27d6"}
Nov 03 17:41:33.769498 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:33.769457    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"]
Nov 03 17:41:33.798320 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:33.798286    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:33.912624 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:33.912591    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"]
Nov 03 17:41:33.937090 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:33.937059    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bacd2fb-f446-4db3-bb86-92a9d923a034-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:33.937404 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:33.937380    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bacd2fb-f446-4db3-bb86-92a9d923a034-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:33.938087 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:33.937619    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bacd2fb-f446-4db3-bb86-92a9d923a034-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:33.938427 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:33.938403    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bacd2fb-f446-4db3-bb86-92a9d923a034-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:33.938627 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:33.938610    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bacd2fb-f446-4db3-bb86-92a9d923a034-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:33.938815 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:33.938796    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bacd2fb-f446-4db3-bb86-92a9d923a034-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:33.938968 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:33.938951    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7rkm\" (UniqueName: \"kubernetes.io/projected/5bacd2fb-f446-4db3-bb86-92a9d923a034-kube-api-access-s7rkm\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:33.939158 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:33.939141    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bacd2fb-f446-4db3-bb86-92a9d923a034-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:33.939376 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:33.939356    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bacd2fb-f446-4db3-bb86-92a9d923a034-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.041260 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.041084    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bacd2fb-f446-4db3-bb86-92a9d923a034-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.041260 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.041150    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bacd2fb-f446-4db3-bb86-92a9d923a034-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.041958 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.041581    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bacd2fb-f446-4db3-bb86-92a9d923a034-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.041958 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.041673    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bacd2fb-f446-4db3-bb86-92a9d923a034-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.041958 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.041729    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bacd2fb-f446-4db3-bb86-92a9d923a034-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.041958 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.041779    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bacd2fb-f446-4db3-bb86-92a9d923a034-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.041958 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.041806    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7rkm\" (UniqueName: \"kubernetes.io/projected/5bacd2fb-f446-4db3-bb86-92a9d923a034-kube-api-access-s7rkm\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.041958 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.041860    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bacd2fb-f446-4db3-bb86-92a9d923a034-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.041958 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.041884    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bacd2fb-f446-4db3-bb86-92a9d923a034-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.043283 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.042858    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bacd2fb-f446-4db3-bb86-92a9d923a034-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.045081 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.043743    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bacd2fb-f446-4db3-bb86-92a9d923a034-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.045081 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.044333    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bacd2fb-f446-4db3-bb86-92a9d923a034-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.045460 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.045220    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bacd2fb-f446-4db3-bb86-92a9d923a034-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.045666 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.045589    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bacd2fb-f446-4db3-bb86-92a9d923a034-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.075040 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.074927    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bacd2fb-f446-4db3-bb86-92a9d923a034-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.075616 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.075583    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bacd2fb-f446-4db3-bb86-92a9d923a034-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.107488 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.107456    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7rkm\" (UniqueName: \"kubernetes.io/projected/5bacd2fb-f446-4db3-bb86-92a9d923a034-kube-api-access-s7rkm\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.107742 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.107713    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bacd2fb-f446-4db3-bb86-92a9d923a034-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-sz4qn\" (UID: \"5bacd2fb-f446-4db3-bb86-92a9d923a034\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.115921 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.115888    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:34.198036 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.197995    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm" event={"ID":"bb85fab8-d811-4572-a0cc-bbb927deac81","Type":"ContainerStarted","Data":"2878a36fa7cdaad79040c54646f026c0ef12aa8a01175c308c6e9c3a80761973"}
Nov 03 17:41:34.198208 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.198074    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:41:34.321613 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.321503    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm" podStartSLOduration=2.388745971 podStartE2EDuration="3.321488299s" totalImagesPullingTime="932.742328ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:41:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:41:34.320384596 +0000 UTC m=+1494.521722652" watchObservedRunningTime="2026-11-03 17:41:34.321488299 +0000 UTC m=+1494.522826351"
Nov 03 17:41:34.595990 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:41:34.595964    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bacd2fb_f446_4db3_bb86_92a9d923a034.slice/crio-3bd25e3121ecafd1f6d0d4b72d4255720e4aa79aa87b5400de5efd8ef53f95c6 WatchSource:0}: Error finding container 3bd25e3121ecafd1f6d0d4b72d4255720e4aa79aa87b5400de5efd8ef53f95c6: Status 404 returned error can't find the container with id 3bd25e3121ecafd1f6d0d4b72d4255720e4aa79aa87b5400de5efd8ef53f95c6
Nov 03 17:41:34.596800 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.596773    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"]
Nov 03 17:41:34.598827 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.598792    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:41:34.598922 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.598876    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:41:34.598922 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:34.598911    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:41:35.206031 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:35.205988    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" event={"ID":"5bacd2fb-f446-4db3-bb86-92a9d923a034","Type":"ContainerStarted","Data":"9e9895795171a916d27c7b89c07abebece830d48b425c148e29c7396fbad7580"}
Nov 03 17:41:35.206557 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:35.206053    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" event={"ID":"5bacd2fb-f446-4db3-bb86-92a9d923a034","Type":"ContainerStarted","Data":"3bd25e3121ecafd1f6d0d4b72d4255720e4aa79aa87b5400de5efd8ef53f95c6"}
Nov 03 17:41:35.337026 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:35.336959    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" podStartSLOduration=2.336936951 podStartE2EDuration="2.336936951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:41:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:41:35.331810492 +0000 UTC m=+1495.533148558" watchObservedRunningTime="2026-11-03 17:41:35.336936951 +0000 UTC m=+1495.538275004"
Nov 03 17:41:36.116554 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:36.116514    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:36.118185 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:36.118155    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-sz4qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 03 17:41:36.118308 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:36.118214    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" podUID="5bacd2fb-f446-4db3-bb86-92a9d923a034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 03 17:41:37.076609 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:41:37.076566    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:41:37.119730 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:37.119689    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-sz4qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 03 17:41:37.120022 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:37.119989    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" podUID="5bacd2fb-f446-4db3-bb86-92a9d923a034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 03 17:41:38.116828 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:38.116790    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-sz4qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 03 17:41:38.117275 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:38.116853    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" podUID="5bacd2fb-f446-4db3-bb86-92a9d923a034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 03 17:41:39.116509 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:39.116475    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-sz4qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 03 17:41:39.116681 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:39.116527    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" podUID="5bacd2fb-f446-4db3-bb86-92a9d923a034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 03 17:41:40.116910 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:40.116881    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-sz4qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 03 17:41:40.117364 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:40.116929    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" podUID="5bacd2fb-f446-4db3-bb86-92a9d923a034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 03 17:41:40.186823 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:40.186795    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:41:40.189266 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:40.189237    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:41:40.212715 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:40.212691    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:41:41.120249 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:41.119657    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-sz4qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 03 17:41:41.120249 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:41.119737    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" podUID="5bacd2fb-f446-4db3-bb86-92a9d923a034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 03 17:41:42.117022 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:42.116984    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-sz4qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 03 17:41:42.117260 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:42.117048    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" podUID="5bacd2fb-f446-4db3-bb86-92a9d923a034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 03 17:41:43.116640 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:43.116607    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-sz4qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 03 17:41:43.117041 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:43.116659    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" podUID="5bacd2fb-f446-4db3-bb86-92a9d923a034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 03 17:41:44.615386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:44.615352    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:44.616291 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:44.616260    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:44.617079 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:44.617062    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn"
Nov 03 17:41:59.641023 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.640989    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"]
Nov 03 17:41:59.645327 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.645301    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.699983 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.699958    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w4-af9e3c-openshift-default-dockercfg-pw9pq\""
Nov 03 17:41:59.748489 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.748451    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9fcf\" (UniqueName: \"kubernetes.io/projected/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-kube-api-access-c9fcf\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.748668 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.748514    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-podinfo\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.748668 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.748629    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-workload-certs\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.748806 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.748679    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-token\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.748806 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.748723    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-workload-socket\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.748806 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.748746    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-data\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.748806 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.748783    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-envoy\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.749024 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.748862    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istiod-ca-cert\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.749024 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.748919    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-credential-socket\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.755214 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.755184    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"]
Nov 03 17:41:59.849879 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.849843    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-podinfo\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.850093 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.849905    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-workload-certs\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.850093 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.849936    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-token\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.850093 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.849979    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-workload-socket\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.850093 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.850005    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-data\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.850093 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.850032    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-envoy\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.850093 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.850092    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istiod-ca-cert\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.850467 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.850177    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-credential-socket\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.850467 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.850246    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9fcf\" (UniqueName: \"kubernetes.io/projected/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-kube-api-access-c9fcf\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.850467 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.850349    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-workload-certs\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.850467 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.850443    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-data\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.850467 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.850459    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-workload-socket\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.850684 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.850580    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-credential-socket\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.850948 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.850928    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istiod-ca-cert\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.852399 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.852375    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-envoy\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.852509 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.852448    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-podinfo\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.913493 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.913419    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-token\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.913655 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.913553    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9fcf\" (UniqueName: \"kubernetes.io/projected/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-kube-api-access-c9fcf\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:41:59.959645 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:41:59.959610    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:42:00.394933 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:42:00.394903    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd396ad_88eb_4fd2_8f21_5856f0bfb254.slice/crio-13ecf18cf7cfbc9c32a962f0437fb19e99974161f8ef9562a245424971b0cb99 WatchSource:0}: Error finding container 13ecf18cf7cfbc9c32a962f0437fb19e99974161f8ef9562a245424971b0cb99: Status 404 returned error can't find the container with id 13ecf18cf7cfbc9c32a962f0437fb19e99974161f8ef9562a245424971b0cb99
Nov 03 17:42:00.396270 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:00.396248    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"]
Nov 03 17:42:00.397785 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:00.397750    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:42:00.397869 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:00.397818    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:42:00.397869 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:00.397847    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:42:00.403992 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:00.403965    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd" event={"ID":"dcd396ad-88eb-4fd2-8f21-5856f0bfb254","Type":"ContainerStarted","Data":"13ecf18cf7cfbc9c32a962f0437fb19e99974161f8ef9562a245424971b0cb99"}
Nov 03 17:42:01.412858 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:01.412823    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd" event={"ID":"dcd396ad-88eb-4fd2-8f21-5856f0bfb254","Type":"ContainerStarted","Data":"878534933b7db30066994525d4b32a42020677b58bb521daa16ef1139dee1353"}
Nov 03 17:42:01.652087 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:01.652028    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd" podStartSLOduration=2.652014413 podStartE2EDuration="2.652014413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:41:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:42:01.589501591 +0000 UTC m=+1521.790839669" watchObservedRunningTime="2026-11-03 17:42:01.652014413 +0000 UTC m=+1521.853352521"
Nov 03 17:42:01.960798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:01.960756    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:42:01.962760 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:01.962722    5021 patch_prober.go:29] interesting pod/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Nov 03 17:42:01.962923 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:01.962775    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd" podUID="dcd396ad-88eb-4fd2-8f21-5856f0bfb254" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Nov 03 17:42:02.960707 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:02.960668    5021 patch_prober.go:29] interesting pod/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Nov 03 17:42:02.961087 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:02.960723    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd" podUID="dcd396ad-88eb-4fd2-8f21-5856f0bfb254" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Nov 03 17:42:03.960481 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:03.960440    5021 patch_prober.go:29] interesting pod/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Nov 03 17:42:03.960664 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:03.960505    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd" podUID="dcd396ad-88eb-4fd2-8f21-5856f0bfb254" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Nov 03 17:42:04.960982 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:04.960944    5021 patch_prober.go:29] interesting pod/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Nov 03 17:42:04.961639 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:04.961603    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd" podUID="dcd396ad-88eb-4fd2-8f21-5856f0bfb254" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Nov 03 17:42:05.960522 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:05.960485    5021 patch_prober.go:29] interesting pod/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Nov 03 17:42:05.960699 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:05.960541    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd" podUID="dcd396ad-88eb-4fd2-8f21-5856f0bfb254" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Nov 03 17:42:07.055205 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:42:07.055150    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:42:07.174129 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:07.174093    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:42:07.174598 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:07.174576    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:42:07.175625 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:07.175602    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:42:37.046724 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:42:37.046685    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:42:41.440679 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.440645    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"]
Nov 03 17:42:41.446627 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.446606    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.501185 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.501154    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-b-8c9b0f-openshift-default-dockercfg-5s7kz\""
Nov 03 17:42:41.509374 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.509345    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7445542c-2ec4-4a34-aae9-315652b35fe4-istiod-ca-cert\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.509500 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.509381    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-workload-socket\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.509500 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.509408    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-credential-socket\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.509583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.509499    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-workload-certs\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.509583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.509530    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-token\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.509583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.509578    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-podinfo\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.509683 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.509627    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-envoy\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.509721 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.509680    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-data\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.509721 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.509699    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44j7z\" (UniqueName: \"kubernetes.io/projected/7445542c-2ec4-4a34-aae9-315652b35fe4-kube-api-access-44j7z\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.558448 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.558402    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"]
Nov 03 17:42:41.611164 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.611125    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7445542c-2ec4-4a34-aae9-315652b35fe4-istiod-ca-cert\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.611164 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.611166    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-workload-socket\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.611450 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.611194    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-credential-socket\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.611450 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.611273    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-workload-certs\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.611450 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.611314    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-token\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.611450 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.611366    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-podinfo\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.611450 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.611391    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-envoy\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.611712 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.611475    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-data\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.611712 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.611507    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44j7z\" (UniqueName: \"kubernetes.io/projected/7445542c-2ec4-4a34-aae9-315652b35fe4-kube-api-access-44j7z\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.611712 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.611614    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-workload-socket\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.611712 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.611664    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-credential-socket\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.612007 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.611985    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-workload-certs\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.612083 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.612018    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7445542c-2ec4-4a34-aae9-315652b35fe4-istiod-ca-cert\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.612083 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.612050    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-data\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.614014 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.613967    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-envoy\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.614261 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.614197    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-podinfo\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.675783 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.675747    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-token\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.675953 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.675899    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44j7z\" (UniqueName: \"kubernetes.io/projected/7445542c-2ec4-4a34-aae9-315652b35fe4-kube-api-access-44j7z\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.760316 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.760289    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:41.941987 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:41.941950    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"]
Nov 03 17:42:42.194409 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:42.194379    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"]
Nov 03 17:42:42.195873 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:42:42.195845    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7445542c_2ec4_4a34_aae9_315652b35fe4.slice/crio-036e53c2b512a8592b8ce39cbeca78c4b317fa0a8d74d2fac7e0dc2357b09492 WatchSource:0}: Error finding container 036e53c2b512a8592b8ce39cbeca78c4b317fa0a8d74d2fac7e0dc2357b09492: Status 404 returned error can't find the container with id 036e53c2b512a8592b8ce39cbeca78c4b317fa0a8d74d2fac7e0dc2357b09492
Nov 03 17:42:42.198773 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:42.198737    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:42:42.198841 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:42.198824    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:42:42.198885 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:42.198870    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:42:42.899235 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:42.899180    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr" event={"ID":"7445542c-2ec4-4a34-aae9-315652b35fe4","Type":"ContainerStarted","Data":"6139fe3a392b6b77939412483c77db16599a649bca6b648b7cca465712e2fb63"}
Nov 03 17:42:42.899624 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:42.899265    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr" event={"ID":"7445542c-2ec4-4a34-aae9-315652b35fe4","Type":"ContainerStarted","Data":"036e53c2b512a8592b8ce39cbeca78c4b317fa0a8d74d2fac7e0dc2357b09492"}
Nov 03 17:42:43.761450 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:43.761409    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:43.763060 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:43.763030    5021 patch_prober.go:29] interesting pod/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Nov 03 17:42:43.763212 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:43.763097    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr" podUID="7445542c-2ec4-4a34-aae9-315652b35fe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Nov 03 17:42:44.760704 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:44.760668    5021 patch_prober.go:29] interesting pod/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Nov 03 17:42:44.761112 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:44.760733    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr" podUID="7445542c-2ec4-4a34-aae9-315652b35fe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Nov 03 17:42:45.760797 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:45.760761    5021 patch_prober.go:29] interesting pod/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Nov 03 17:42:45.761249 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:45.760836    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr" podUID="7445542c-2ec4-4a34-aae9-315652b35fe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Nov 03 17:42:46.760844 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:46.760809    5021 patch_prober.go:29] interesting pod/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Nov 03 17:42:46.761299 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:46.760874    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr" podUID="7445542c-2ec4-4a34-aae9-315652b35fe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Nov 03 17:42:47.760720 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:47.760687    5021 patch_prober.go:29] interesting pod/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Nov 03 17:42:47.760911 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:47.760740    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr" podUID="7445542c-2ec4-4a34-aae9-315652b35fe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Nov 03 17:42:48.760733 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:48.760638    5021 patch_prober.go:29] interesting pod/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Nov 03 17:42:48.760733 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:48.760702    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr" podUID="7445542c-2ec4-4a34-aae9-315652b35fe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Nov 03 17:42:49.765572 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:49.765538    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:49.766031 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:49.766011    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:49.766861 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:49.766842    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 17:42:49.931571 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:49.931521    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr" podStartSLOduration=8.931506304 podStartE2EDuration="8.931506304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:42:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:42:43.04963083 +0000 UTC m=+1563.250968885" watchObservedRunningTime="2026-11-03 17:42:49.931506304 +0000 UTC m=+1570.132844355"
Nov 03 17:42:55.536400 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:55.536352    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ht4p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 17:42:55.537511 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:55.537474    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p" podUID="54ad6a25-5ebf-4333-85ee-2a32e01c785a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 17:42:56.963491 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:56.963428    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4" podUID="f7b69cb9-f649-4675-bf94-4633697601c5" containerName="main" containerID="cri-o://aa7c8a9a233b1461429283b6a80029bfead3fc1fd4d8dfc9e5707b863ec44ea7" gracePeriod=45
Nov 03 17:42:57.263075 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.263047    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:42:57.346485 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.346456    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f7b69cb9-f649-4675-bf94-4633697601c5-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7b69cb9-f649-4675-bf94-4633697601c5-tls-certs\") pod \"f7b69cb9-f649-4675-bf94-4633697601c5\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") "
Nov 03 17:42:57.346648 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.346505    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-home\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-home\") pod \"f7b69cb9-f649-4675-bf94-4633697601c5\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") "
Nov 03 17:42:57.346648 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.346527    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7b69cb9-f649-4675-bf94-4633697601c5-kube-api-access-w7kn2\" (UniqueName: \"kubernetes.io/projected/f7b69cb9-f649-4675-bf94-4633697601c5-kube-api-access-w7kn2\") pod \"f7b69cb9-f649-4675-bf94-4633697601c5\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") "
Nov 03 17:42:57.346648 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.346555    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-dshm\") pod \"f7b69cb9-f649-4675-bf94-4633697601c5\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") "
Nov 03 17:42:57.346766 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.346709    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-tmp-dir\") pod \"f7b69cb9-f649-4675-bf94-4633697601c5\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") "
Nov 03 17:42:57.346766 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.346725    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-home" pod "f7b69cb9-f649-4675-bf94-4633697601c5" (UID: "f7b69cb9-f649-4675-bf94-4633697601c5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:42:57.346873 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.346811    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-model-cache\") pod \"f7b69cb9-f649-4675-bf94-4633697601c5\" (UID: \"f7b69cb9-f649-4675-bf94-4633697601c5\") "
Nov 03 17:42:57.347002 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.346980    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-tmp-dir" pod "f7b69cb9-f649-4675-bf94-4633697601c5" (UID: "f7b69cb9-f649-4675-bf94-4633697601c5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:42:57.347086 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.347068    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-model-cache" pod "f7b69cb9-f649-4675-bf94-4633697601c5" (UID: "f7b69cb9-f649-4675-bf94-4633697601c5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:42:57.347311 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.347295    5021 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-model-cache\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:42:57.347361 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.347314    5021 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-home\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:42:57.347361 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.347323    5021 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-tmp-dir\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:42:57.351599 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.351571    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7b69cb9-f649-4675-bf94-4633697601c5-tls-certs" pod "f7b69cb9-f649-4675-bf94-4633697601c5" (UID: "f7b69cb9-f649-4675-bf94-4633697601c5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:42:57.351827 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.351806    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b69cb9-f649-4675-bf94-4633697601c5-kube-api-access-w7kn2" pod "f7b69cb9-f649-4675-bf94-4633697601c5" (UID: "f7b69cb9-f649-4675-bf94-4633697601c5"). InnerVolumeSpecName "kube-api-access-w7kn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:42:57.351896 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.351837    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-dshm" pod "f7b69cb9-f649-4675-bf94-4633697601c5" (UID: "f7b69cb9-f649-4675-bf94-4633697601c5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:42:57.448585 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.448550    5021 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7b69cb9-f649-4675-bf94-4633697601c5-tls-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:42:57.448585 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.448579    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7kn2\" (UniqueName: \"kubernetes.io/projected/f7b69cb9-f649-4675-bf94-4633697601c5-kube-api-access-w7kn2\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:42:57.448585 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.448590    5021 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7b69cb9-f649-4675-bf94-4633697601c5-dshm\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:42:57.760432 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.760399    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"]
Nov 03 17:42:57.760623 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:57.760588    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm" podUID="bb85fab8-d811-4572-a0cc-bbb927deac81" containerName="maas-api" containerID="cri-o://2878a36fa7cdaad79040c54646f026c0ef12aa8a01175c308c6e9c3a80761973" gracePeriod=30
Nov 03 17:42:58.041268 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.041196    5021 generic.go:356] "Generic (PLEG): container finished" podID="bb85fab8-d811-4572-a0cc-bbb927deac81" containerID="2878a36fa7cdaad79040c54646f026c0ef12aa8a01175c308c6e9c3a80761973" exitCode=0
Nov 03 17:42:58.041653 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.041288    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm" event={"ID":"bb85fab8-d811-4572-a0cc-bbb927deac81","Type":"ContainerDied","Data":"2878a36fa7cdaad79040c54646f026c0ef12aa8a01175c308c6e9c3a80761973"}
Nov 03 17:42:58.041653 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.041342    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm" event={"ID":"bb85fab8-d811-4572-a0cc-bbb927deac81","Type":"ContainerDied","Data":"039c731a196c12514d167cc7e3c74cff081565d120e0aa9a520fe955359e27d6"}
Nov 03 17:42:58.041653 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.041359    5021 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="039c731a196c12514d167cc7e3c74cff081565d120e0aa9a520fe955359e27d6"
Nov 03 17:42:58.043005 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.042983    5021 generic.go:356] "Generic (PLEG): container finished" podID="f7b69cb9-f649-4675-bf94-4633697601c5" containerID="aa7c8a9a233b1461429283b6a80029bfead3fc1fd4d8dfc9e5707b863ec44ea7" exitCode=0
Nov 03 17:42:58.043125 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.043028    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"
Nov 03 17:42:58.043125 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.043067    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4" event={"ID":"f7b69cb9-f649-4675-bf94-4633697601c5","Type":"ContainerDied","Data":"aa7c8a9a233b1461429283b6a80029bfead3fc1fd4d8dfc9e5707b863ec44ea7"}
Nov 03 17:42:58.043125 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.043106    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4" event={"ID":"f7b69cb9-f649-4675-bf94-4633697601c5","Type":"ContainerDied","Data":"4cf83071b92b3a4a632976b678cf3908669d6ac0a87466a852fc71aefb4e6e51"}
Nov 03 17:42:58.043287 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.043128    5021 scope.go:122] "RemoveContainer" containerID="aa7c8a9a233b1461429283b6a80029bfead3fc1fd4d8dfc9e5707b863ec44ea7"
Nov 03 17:42:58.061381 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.061356    5021 scope.go:122] "RemoveContainer" containerID="aa7c8a9a233b1461429283b6a80029bfead3fc1fd4d8dfc9e5707b863ec44ea7"
Nov 03 17:42:58.061661 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:42:58.061643    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa7c8a9a233b1461429283b6a80029bfead3fc1fd4d8dfc9e5707b863ec44ea7\": container with ID starting with aa7c8a9a233b1461429283b6a80029bfead3fc1fd4d8dfc9e5707b863ec44ea7 not found: ID does not exist" containerID="aa7c8a9a233b1461429283b6a80029bfead3fc1fd4d8dfc9e5707b863ec44ea7"
Nov 03 17:42:58.061709 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.061672    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa7c8a9a233b1461429283b6a80029bfead3fc1fd4d8dfc9e5707b863ec44ea7"} err="failed to get container status \"aa7c8a9a233b1461429283b6a80029bfead3fc1fd4d8dfc9e5707b863ec44ea7\": rpc error: code = NotFound desc = could not find container \"aa7c8a9a233b1461429283b6a80029bfead3fc1fd4d8dfc9e5707b863ec44ea7\": container with ID starting with aa7c8a9a233b1461429283b6a80029bfead3fc1fd4d8dfc9e5707b863ec44ea7 not found: ID does not exist"
Nov 03 17:42:58.063520 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.063502    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:42:58.158961 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.158262    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bb85fab8-d811-4572-a0cc-bbb927deac81-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb85fab8-d811-4572-a0cc-bbb927deac81-openshift-service-ca\") pod \"bb85fab8-d811-4572-a0cc-bbb927deac81\" (UID: \"bb85fab8-d811-4572-a0cc-bbb927deac81\") "
Nov 03 17:42:58.158961 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.158358    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bb85fab8-d811-4572-a0cc-bbb927deac81-metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb85fab8-d811-4572-a0cc-bbb927deac81-metrics-certs\") pod \"bb85fab8-d811-4572-a0cc-bbb927deac81\" (UID: \"bb85fab8-d811-4572-a0cc-bbb927deac81\") "
Nov 03 17:42:58.158961 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.158508    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb85fab8-d811-4572-a0cc-bbb927deac81-kube-api-access-bzpdg\" (UniqueName: \"kubernetes.io/projected/bb85fab8-d811-4572-a0cc-bbb927deac81-kube-api-access-bzpdg\") pod \"bb85fab8-d811-4572-a0cc-bbb927deac81\" (UID: \"bb85fab8-d811-4572-a0cc-bbb927deac81\") "
Nov 03 17:42:58.158961 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.158654    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb85fab8-d811-4572-a0cc-bbb927deac81-openshift-service-ca" pod "bb85fab8-d811-4572-a0cc-bbb927deac81" (UID: "bb85fab8-d811-4572-a0cc-bbb927deac81"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:42:58.158961 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.158666    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bb85fab8-d811-4572-a0cc-bbb927deac81-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb85fab8-d811-4572-a0cc-bbb927deac81-maas-api-tls\") pod \"bb85fab8-d811-4572-a0cc-bbb927deac81\" (UID: \"bb85fab8-d811-4572-a0cc-bbb927deac81\") "
Nov 03 17:42:58.159387 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.159329    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb85fab8-d811-4572-a0cc-bbb927deac81-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:42:58.161499 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.161449    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb85fab8-d811-4572-a0cc-bbb927deac81-kube-api-access-bzpdg" pod "bb85fab8-d811-4572-a0cc-bbb927deac81" (UID: "bb85fab8-d811-4572-a0cc-bbb927deac81"). InnerVolumeSpecName "kube-api-access-bzpdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:42:58.161932 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.161904    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb85fab8-d811-4572-a0cc-bbb927deac81-maas-api-tls" pod "bb85fab8-d811-4572-a0cc-bbb927deac81" (UID: "bb85fab8-d811-4572-a0cc-bbb927deac81"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:42:58.162696 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.162674    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb85fab8-d811-4572-a0cc-bbb927deac81-metrics-certs" pod "bb85fab8-d811-4572-a0cc-bbb927deac81" (UID: "bb85fab8-d811-4572-a0cc-bbb927deac81"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:42:58.214709 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.214662    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"]
Nov 03 17:42:58.219822 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.219793    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w4-147834/rate-test-model-147834-kserve-547f6c67c-lmpj4"]
Nov 03 17:42:58.260575 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.260539    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb85fab8-d811-4572-a0cc-bbb927deac81-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:42:58.260575 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.260568    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb85fab8-d811-4572-a0cc-bbb927deac81-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:42:58.260575 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:58.260580    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzpdg\" (UniqueName: \"kubernetes.io/projected/bb85fab8-d811-4572-a0cc-bbb927deac81-kube-api-access-bzpdg\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:42:59.050743 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:59.050715    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"
Nov 03 17:42:59.224989 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:59.224954    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"]
Nov 03 17:42:59.275461 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:42:59.275428    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5f88f673-77f64649b-clpgm"]
Nov 03 17:43:00.004975 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:00.004942    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bb85fab8-d811-4572-a0cc-bbb927deac81" path="/var/lib/kubelet/pods/bb85fab8-d811-4572-a0cc-bbb927deac81/volumes"
Nov 03 17:43:00.005608 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:00.005582    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f7b69cb9-f649-4675-bf94-4633697601c5" path="/var/lib/kubelet/pods/f7b69cb9-f649-4675-bf94-4633697601c5/volumes"
Nov 03 17:43:07.062039 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:43:07.061991    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:43:10.546258 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:10.543369    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ht4p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 17:43:10.546258 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:10.543512    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p" podUID="54ad6a25-5ebf-4333-85ee-2a32e01c785a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 17:43:14.154419 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:14.154375    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"]
Nov 03 17:43:19.155115 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:19.155064    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk" podUID="de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b" containerName="payload-pre-processing" containerID="cri-o://1b896bdee365bfdd7a89d8d3748d0806e26dcfdceb0f2da00eb6c159db792d17" gracePeriod=25
Nov 03 17:43:23.326752 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:23.326710    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk" podUID="de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:43:28.054771 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:28.054714    5021 pod_container_manager_linux.go:218] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","podf7b69cb9-f649-4675-bf94-4633697601c5"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort podf7b69cb9-f649-4675-bf94-4633697601c5] : Timed out while waiting for systemd to remove kubepods-besteffort-podf7b69cb9_f649_4675_bf94_4633697601c5.slice"
Nov 03 17:43:28.054771 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:28.054765    5021 kubelet_pods.go:2797] "Failed to destroy orphaned pod cgroup" podUID="f7b69cb9-f649-4675-bf94-4633697601c5" err="failed to delete cgroup paths for [kubepods besteffort podf7b69cb9-f649-4675-bf94-4633697601c5] : unable to destroy cgroup paths for cgroup [kubepods besteffort podf7b69cb9-f649-4675-bf94-4633697601c5] : Timed out while waiting for systemd to remove kubepods-besteffort-podf7b69cb9_f649_4675_bf94_4633697601c5.slice"
Nov 03 17:43:29.563082 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.563046    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"]
Nov 03 17:43:29.563873 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.563853    5021 cpu_manager.go:414] "containerMap: removing container" podUID="f7b69cb9-f649-4675-bf94-4633697601c5" containerName="main"
Nov 03 17:43:29.563873 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.563872    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7b69cb9-f649-4675-bf94-4633697601c5" containerName="main"
Nov 03 17:43:29.564034 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.563889    5021 cpu_manager.go:414] "containerMap: removing container" podUID="bb85fab8-d811-4572-a0cc-bbb927deac81" containerName="maas-api"
Nov 03 17:43:29.564034 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.563894    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb85fab8-d811-4572-a0cc-bbb927deac81" containerName="maas-api"
Nov 03 17:43:29.564034 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.564012    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7b69cb9-f649-4675-bf94-4633697601c5" containerName="main"
Nov 03 17:43:29.564034 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.564025    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb85fab8-d811-4572-a0cc-bbb927deac81" containerName="maas-api"
Nov 03 17:43:29.567598 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.567581    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.631337 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.631304    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"]
Nov 03 17:43:29.682401 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.682361    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-685cm\""
Nov 03 17:43:29.682641 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.682469    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Nov 03 17:43:29.682641 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.682523    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Nov 03 17:43:29.682641 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.682555    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Nov 03 17:43:29.738533 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.738494    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.738708 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.738678    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92c416fa-3174-4000-a237-55f489552b5c-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.738752 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.738711    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.738831 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.738818    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/92c416fa-3174-4000-a237-55f489552b5c-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.738871 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.738850    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.738949 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.738933    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/92c416fa-3174-4000-a237-55f489552b5c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.738985 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.738964    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qm7g\" (UniqueName: \"kubernetes.io/projected/92c416fa-3174-4000-a237-55f489552b5c-kube-api-access-8qm7g\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.839939 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.839852    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92c416fa-3174-4000-a237-55f489552b5c-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.839939 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.839890    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.839939 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.839939    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/92c416fa-3174-4000-a237-55f489552b5c-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.840246 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.839961    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.840246 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.840003    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/92c416fa-3174-4000-a237-55f489552b5c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.840246 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.840035    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qm7g\" (UniqueName: \"kubernetes.io/projected/92c416fa-3174-4000-a237-55f489552b5c-kube-api-access-8qm7g\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.840246 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.840108    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.841181 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.841150    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/92c416fa-3174-4000-a237-55f489552b5c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.842892 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.842627    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/92c416fa-3174-4000-a237-55f489552b5c-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.842892 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.842836    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.842892 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.842851    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.843145 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.843045    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.910658 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.910620    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92c416fa-3174-4000-a237-55f489552b5c-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:29.910878 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:29.910856    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qm7g\" (UniqueName: \"kubernetes.io/projected/92c416fa-3174-4000-a237-55f489552b5c-kube-api-access-8qm7g\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8qbkp\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:30.181021 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:30.180936    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:30.621386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:30.621358    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"]
Nov 03 17:43:30.624075 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:43:30.624048    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c416fa_3174_4000_a237_55f489552b5c.slice/crio-35a570bb14e7e8b1809643a3ec28e0149105ed53a32401177199c59fb7111fa1 WatchSource:0}: Error finding container 35a570bb14e7e8b1809643a3ec28e0149105ed53a32401177199c59fb7111fa1: Status 404 returned error can't find the container with id 35a570bb14e7e8b1809643a3ec28e0149105ed53a32401177199c59fb7111fa1
Nov 03 17:43:31.342090 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:31.342048    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp" event={"ID":"92c416fa-3174-4000-a237-55f489552b5c","Type":"ContainerStarted","Data":"35a570bb14e7e8b1809643a3ec28e0149105ed53a32401177199c59fb7111fa1"}
Nov 03 17:43:33.326435 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:33.326397    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk" podUID="de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:43:35.359531 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:35.359500    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:43:35.359798 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:35.359567    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:43:36.377518 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:36.377478    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp" event={"ID":"92c416fa-3174-4000-a237-55f489552b5c","Type":"ContainerStarted","Data":"bc51615f563b69a7e33bf0c7303493a20a55a2a6624ff273bc957c39c17a6cae"}
Nov 03 17:43:36.377943 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:36.377615    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:36.379549 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:36.379523    5021 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-8qbkp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 17:43:36.379698 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:36.379577    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp" podUID="92c416fa-3174-4000-a237-55f489552b5c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 17:43:36.595487 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:36.595422    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp" podStartSLOduration=2.863154147 podStartE2EDuration="7.595400967s" totalImagesPullingTime="4.73224682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:43:36.556101919 +0000 UTC m=+1616.757439983" watchObservedRunningTime="2026-11-03 17:43:36.595400967 +0000 UTC m=+1616.796739019"
Nov 03 17:43:37.051824 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:43:37.051783    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:43:37.386542 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:37.386462    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:43:39.401398 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:39.401361    5021 generic.go:356] "Generic (PLEG): container finished" podID="de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b" containerID="1b896bdee365bfdd7a89d8d3748d0806e26dcfdceb0f2da00eb6c159db792d17" exitCode=0
Nov 03 17:43:39.401854 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:39.401438    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk" event={"ID":"de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b","Type":"ContainerDied","Data":"1b896bdee365bfdd7a89d8d3748d0806e26dcfdceb0f2da00eb6c159db792d17"}
Nov 03 17:43:39.428335 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:39.428277    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"
Nov 03 17:43:39.474066 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:39.474030    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b-plugins-config-volume\") pod \"de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b\" (UID: \"de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b\") "
Nov 03 17:43:39.474361 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:39.474337    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b-kube-api-access-6s9x8\" (UniqueName: \"kubernetes.io/projected/de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b-kube-api-access-6s9x8\") pod \"de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b\" (UID: \"de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b\") "
Nov 03 17:43:39.474520 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:39.474495    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b-plugins-config-volume" pod "de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b" (UID: "de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:43:39.474775 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:39.474761    5021 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b-plugins-config-volume\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:43:39.476423 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:39.476389    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b-kube-api-access-6s9x8" pod "de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b" (UID: "de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b"). InnerVolumeSpecName "kube-api-access-6s9x8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:43:39.575579 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:39.575542    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s9x8\" (UniqueName: \"kubernetes.io/projected/de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b-kube-api-access-6s9x8\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:43:40.409653 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:40.409551    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk" event={"ID":"de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b","Type":"ContainerDied","Data":"4780ee0742254f5136c635cbee2240545e5bd0f4c7f28589d8a6ea574dd9bddd"}
Nov 03 17:43:40.409653 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:40.409629    5021 scope.go:122] "RemoveContainer" containerID="1b896bdee365bfdd7a89d8d3748d0806e26dcfdceb0f2da00eb6c159db792d17"
Nov 03 17:43:40.410132 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:40.409573    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"
Nov 03 17:43:40.588401 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:40.588362    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"]
Nov 03 17:43:40.594772 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:40.594741    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-49c123d1-7496876dc-j89gk"]
Nov 03 17:43:42.004118 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:43:42.004087    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b" path="/var/lib/kubelet/pods/de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b/volumes"
Nov 03 17:44:07.051320 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:44:07.051252    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:44:34.673311 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:34.673271    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"]
Nov 03 17:44:34.673869 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:34.673523    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg" podUID="e62c266b-f033-413e-a8c2-a634c5a6c14d" containerName="maas-api" containerID="cri-o://a959b3cd77e90480d50d6c46f8ccdc5ae16e546f4cb29318ad3256d5808c3a35" gracePeriod=30
Nov 03 17:44:34.966415 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:34.966386    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:44:35.093686 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.093644    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e62c266b-f033-413e-a8c2-a634c5a6c14d-kube-api-access-8rlbp\" (UniqueName: \"kubernetes.io/projected/e62c266b-f033-413e-a8c2-a634c5a6c14d-kube-api-access-8rlbp\") pod \"e62c266b-f033-413e-a8c2-a634c5a6c14d\" (UID: \"e62c266b-f033-413e-a8c2-a634c5a6c14d\") "
Nov 03 17:44:35.093876 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.093724    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e62c266b-f033-413e-a8c2-a634c5a6c14d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e62c266b-f033-413e-a8c2-a634c5a6c14d-metrics-certs\") pod \"e62c266b-f033-413e-a8c2-a634c5a6c14d\" (UID: \"e62c266b-f033-413e-a8c2-a634c5a6c14d\") "
Nov 03 17:44:35.093876 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.093848    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e62c266b-f033-413e-a8c2-a634c5a6c14d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e62c266b-f033-413e-a8c2-a634c5a6c14d-maas-api-tls\") pod \"e62c266b-f033-413e-a8c2-a634c5a6c14d\" (UID: \"e62c266b-f033-413e-a8c2-a634c5a6c14d\") "
Nov 03 17:44:35.094001 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.093989    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e62c266b-f033-413e-a8c2-a634c5a6c14d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e62c266b-f033-413e-a8c2-a634c5a6c14d-openshift-service-ca\") pod \"e62c266b-f033-413e-a8c2-a634c5a6c14d\" (UID: \"e62c266b-f033-413e-a8c2-a634c5a6c14d\") "
Nov 03 17:44:35.095300 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.095272    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e62c266b-f033-413e-a8c2-a634c5a6c14d-openshift-service-ca" pod "e62c266b-f033-413e-a8c2-a634c5a6c14d" (UID: "e62c266b-f033-413e-a8c2-a634c5a6c14d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:44:35.098489 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.098448    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e62c266b-f033-413e-a8c2-a634c5a6c14d-kube-api-access-8rlbp" pod "e62c266b-f033-413e-a8c2-a634c5a6c14d" (UID: "e62c266b-f033-413e-a8c2-a634c5a6c14d"). InnerVolumeSpecName "kube-api-access-8rlbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:44:35.101076 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.101034    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e62c266b-f033-413e-a8c2-a634c5a6c14d-maas-api-tls" pod "e62c266b-f033-413e-a8c2-a634c5a6c14d" (UID: "e62c266b-f033-413e-a8c2-a634c5a6c14d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:44:35.101182 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.101069    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e62c266b-f033-413e-a8c2-a634c5a6c14d-metrics-certs" pod "e62c266b-f033-413e-a8c2-a634c5a6c14d" (UID: "e62c266b-f033-413e-a8c2-a634c5a6c14d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:44:35.196321 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.196238    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e62c266b-f033-413e-a8c2-a634c5a6c14d-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:44:35.196321 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.196276    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rlbp\" (UniqueName: \"kubernetes.io/projected/e62c266b-f033-413e-a8c2-a634c5a6c14d-kube-api-access-8rlbp\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:44:35.196321 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.196289    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e62c266b-f033-413e-a8c2-a634c5a6c14d-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:44:35.196321 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.196298    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e62c266b-f033-413e-a8c2-a634c5a6c14d-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:44:35.790503 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.790468    5021 generic.go:356] "Generic (PLEG): container finished" podID="e62c266b-f033-413e-a8c2-a634c5a6c14d" containerID="a959b3cd77e90480d50d6c46f8ccdc5ae16e546f4cb29318ad3256d5808c3a35" exitCode=0
Nov 03 17:44:35.790911 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.790519    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"
Nov 03 17:44:35.790911 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.790555    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg" event={"ID":"e62c266b-f033-413e-a8c2-a634c5a6c14d","Type":"ContainerDied","Data":"a959b3cd77e90480d50d6c46f8ccdc5ae16e546f4cb29318ad3256d5808c3a35"}
Nov 03 17:44:35.790911 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.790612    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg" event={"ID":"e62c266b-f033-413e-a8c2-a634c5a6c14d","Type":"ContainerDied","Data":"f27f1672b8d22d81abfa2c56db4f149898447125140e560c8ba32a18eff5345f"}
Nov 03 17:44:35.790911 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.790651    5021 scope.go:122] "RemoveContainer" containerID="a959b3cd77e90480d50d6c46f8ccdc5ae16e546f4cb29318ad3256d5808c3a35"
Nov 03 17:44:35.809642 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.809616    5021 scope.go:122] "RemoveContainer" containerID="a959b3cd77e90480d50d6c46f8ccdc5ae16e546f4cb29318ad3256d5808c3a35"
Nov 03 17:44:35.809940 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:44:35.809914    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a959b3cd77e90480d50d6c46f8ccdc5ae16e546f4cb29318ad3256d5808c3a35\": container with ID starting with a959b3cd77e90480d50d6c46f8ccdc5ae16e546f4cb29318ad3256d5808c3a35 not found: ID does not exist" containerID="a959b3cd77e90480d50d6c46f8ccdc5ae16e546f4cb29318ad3256d5808c3a35"
Nov 03 17:44:35.810034 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.809946    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a959b3cd77e90480d50d6c46f8ccdc5ae16e546f4cb29318ad3256d5808c3a35"} err="failed to get container status \"a959b3cd77e90480d50d6c46f8ccdc5ae16e546f4cb29318ad3256d5808c3a35\": rpc error: code = NotFound desc = could not find container \"a959b3cd77e90480d50d6c46f8ccdc5ae16e546f4cb29318ad3256d5808c3a35\": container with ID starting with a959b3cd77e90480d50d6c46f8ccdc5ae16e546f4cb29318ad3256d5808c3a35 not found: ID does not exist"
Nov 03 17:44:35.966556 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:35.966522    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"]
Nov 03 17:44:36.018381 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:36.018346    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-72kvg"]
Nov 03 17:44:37.072250 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:44:37.071488    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:44:38.003616 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:44:38.003583    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e62c266b-f033-413e-a8c2-a634c5a6c14d" path="/var/lib/kubelet/pods/e62c266b-f033-413e-a8c2-a634c5a6c14d/volumes"
Nov 03 17:45:00.244113 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:00.244074    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"]
Nov 03 17:45:00.244569 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:00.244319    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq" podUID="5a1ddb65-ca04-4826-afaa-ab3e271011f6" containerName="istio-proxy" containerID="cri-o://68ddbec63dd4031eb32d8baafd9c999cb74c0c678f53b61c8576ecd1979e5199" gracePeriod=30
Nov 03 17:45:01.282702 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:01.282665    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 17:45:01.283179 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:01.282742    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq" podUID="5a1ddb65-ca04-4826-afaa-ab3e271011f6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 17:45:05.558492 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.558421    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:45:05.584736 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.584698    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-data\") pod \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") "
Nov 03 17:45:05.584736 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.584738    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-credential-socket\") pod \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") "
Nov 03 17:45:05.584980 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.584783    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-workload-socket\") pod \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") "
Nov 03 17:45:05.584980 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.584813    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-podinfo\") pod \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") "
Nov 03 17:45:05.585105 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.584978    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-data" pod "5a1ddb65-ca04-4826-afaa-ab3e271011f6" (UID: "5a1ddb65-ca04-4826-afaa-ab3e271011f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:45:05.585105 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.584986    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istiod-ca-cert\") pod \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") "
Nov 03 17:45:05.585105 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.585077    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-credential-socket" pod "5a1ddb65-ca04-4826-afaa-ab3e271011f6" (UID: "5a1ddb65-ca04-4826-afaa-ab3e271011f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:45:05.585105 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.585093    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-token\" (UniqueName: \"kubernetes.io/projected/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-token\") pod \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") "
Nov 03 17:45:05.585340 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.585102    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-workload-socket" pod "5a1ddb65-ca04-4826-afaa-ab3e271011f6" (UID: "5a1ddb65-ca04-4826-afaa-ab3e271011f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:45:05.585340 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.585209    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-envoy\") pod \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") "
Nov 03 17:45:05.585340 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.585291    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5a1ddb65-ca04-4826-afaa-ab3e271011f6-kube-api-access-vxrdr\" (UniqueName: \"kubernetes.io/projected/5a1ddb65-ca04-4826-afaa-ab3e271011f6-kube-api-access-vxrdr\") pod \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") "
Nov 03 17:45:05.585340 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.585333    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istiod-ca-cert" pod "5a1ddb65-ca04-4826-afaa-ab3e271011f6" (UID: "5a1ddb65-ca04-4826-afaa-ab3e271011f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:45:05.585605 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.585389    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-workload-certs\") pod \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\" (UID: \"5a1ddb65-ca04-4826-afaa-ab3e271011f6\") "
Nov 03 17:45:05.585745 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.585721    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-workload-certs" pod "5a1ddb65-ca04-4826-afaa-ab3e271011f6" (UID: "5a1ddb65-ca04-4826-afaa-ab3e271011f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:45:05.586096 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.585951    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:45:05.586096 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.585977    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:45:05.586096 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.585994    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:45:05.586096 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.586008    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:45:05.586096 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.586023    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:45:05.587292 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.587270    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-podinfo" pod "5a1ddb65-ca04-4826-afaa-ab3e271011f6" (UID: "5a1ddb65-ca04-4826-afaa-ab3e271011f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 17:45:05.587402 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.587360    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-token" pod "5a1ddb65-ca04-4826-afaa-ab3e271011f6" (UID: "5a1ddb65-ca04-4826-afaa-ab3e271011f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:45:05.587402 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.587385    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-envoy" pod "5a1ddb65-ca04-4826-afaa-ab3e271011f6" (UID: "5a1ddb65-ca04-4826-afaa-ab3e271011f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:45:05.587561 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.587545    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a1ddb65-ca04-4826-afaa-ab3e271011f6-kube-api-access-vxrdr" pod "5a1ddb65-ca04-4826-afaa-ab3e271011f6" (UID: "5a1ddb65-ca04-4826-afaa-ab3e271011f6"). InnerVolumeSpecName "kube-api-access-vxrdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:45:05.687610 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.687559    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:45:05.687610 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.687589    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:45:05.687610 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.687599    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxrdr\" (UniqueName: \"kubernetes.io/projected/5a1ddb65-ca04-4826-afaa-ab3e271011f6-kube-api-access-vxrdr\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:45:05.687610 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:05.687609    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a1ddb65-ca04-4826-afaa-ab3e271011f6-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:45:06.019255 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:06.019192    5021 generic.go:356] "Generic (PLEG): container finished" podID="5a1ddb65-ca04-4826-afaa-ab3e271011f6" containerID="68ddbec63dd4031eb32d8baafd9c999cb74c0c678f53b61c8576ecd1979e5199" exitCode=0
Nov 03 17:45:06.019881 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:06.019266    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq" event={"ID":"5a1ddb65-ca04-4826-afaa-ab3e271011f6","Type":"ContainerDied","Data":"68ddbec63dd4031eb32d8baafd9c999cb74c0c678f53b61c8576ecd1979e5199"}
Nov 03 17:45:06.019881 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:06.019334    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq" event={"ID":"5a1ddb65-ca04-4826-afaa-ab3e271011f6","Type":"ContainerDied","Data":"9f9dcf7f51cabbf5a5fcc1dcf285b88187334824a6582267b3243a52a2cb225a"}
Nov 03 17:45:06.019881 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:06.019361    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"
Nov 03 17:45:06.019881 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:06.019567    5021 scope.go:122] "RemoveContainer" containerID="68ddbec63dd4031eb32d8baafd9c999cb74c0c678f53b61c8576ecd1979e5199"
Nov 03 17:45:06.032032 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:06.032009    5021 scope.go:122] "RemoveContainer" containerID="68ddbec63dd4031eb32d8baafd9c999cb74c0c678f53b61c8576ecd1979e5199"
Nov 03 17:45:06.032377 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:45:06.032339    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68ddbec63dd4031eb32d8baafd9c999cb74c0c678f53b61c8576ecd1979e5199\": container with ID starting with 68ddbec63dd4031eb32d8baafd9c999cb74c0c678f53b61c8576ecd1979e5199 not found: ID does not exist" containerID="68ddbec63dd4031eb32d8baafd9c999cb74c0c678f53b61c8576ecd1979e5199"
Nov 03 17:45:06.032498 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:06.032371    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68ddbec63dd4031eb32d8baafd9c999cb74c0c678f53b61c8576ecd1979e5199"} err="failed to get container status \"68ddbec63dd4031eb32d8baafd9c999cb74c0c678f53b61c8576ecd1979e5199\": rpc error: code = NotFound desc = could not find container \"68ddbec63dd4031eb32d8baafd9c999cb74c0c678f53b61c8576ecd1979e5199\": container with ID starting with 68ddbec63dd4031eb32d8baafd9c999cb74c0c678f53b61c8576ecd1979e5199 not found: ID does not exist"
Nov 03 17:45:06.194267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:06.194210    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"]
Nov 03 17:45:06.246072 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:06.246034    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-vwqkq"]
Nov 03 17:45:07.046355 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:45:07.046320    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:45:08.003516 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:08.003483    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5a1ddb65-ca04-4826-afaa-ab3e271011f6" path="/var/lib/kubelet/pods/5a1ddb65-ca04-4826-afaa-ab3e271011f6/volumes"
Nov 03 17:45:11.664093 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.664058    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"]
Nov 03 17:45:11.664737 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.664720    5021 cpu_manager.go:414] "containerMap: removing container" podUID="de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b" containerName="payload-pre-processing"
Nov 03 17:45:11.664787 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.664739    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b" containerName="payload-pre-processing"
Nov 03 17:45:11.664787 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.664764    5021 cpu_manager.go:414] "containerMap: removing container" podUID="5a1ddb65-ca04-4826-afaa-ab3e271011f6" containerName="istio-proxy"
Nov 03 17:45:11.664787 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.664769    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5a1ddb65-ca04-4826-afaa-ab3e271011f6" containerName="istio-proxy"
Nov 03 17:45:11.664787 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.664776    5021 cpu_manager.go:414] "containerMap: removing container" podUID="e62c266b-f033-413e-a8c2-a634c5a6c14d" containerName="maas-api"
Nov 03 17:45:11.664787 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.664781    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e62c266b-f033-413e-a8c2-a634c5a6c14d" containerName="maas-api"
Nov 03 17:45:11.664938 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.664868    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="5a1ddb65-ca04-4826-afaa-ab3e271011f6" containerName="istio-proxy"
Nov 03 17:45:11.664938 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.664875    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="e62c266b-f033-413e-a8c2-a634c5a6c14d" containerName="maas-api"
Nov 03 17:45:11.664938 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.664884    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="de02ff4a-3aeb-43ef-bfbd-8f72a8ca363b" containerName="payload-pre-processing"
Nov 03 17:45:11.670001 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.669981    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:45:11.724368 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.724334    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"]
Nov 03 17:45:11.758197 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.758159    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvtxh\" (UniqueName: \"kubernetes.io/projected/714239fc-8cc6-4c75-9b43-331de350552f-kube-api-access-lvtxh\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-4chsh\" (UID: \"714239fc-8cc6-4c75-9b43-331de350552f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:45:11.758420 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.758367    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/714239fc-8cc6-4c75-9b43-331de350552f-metrics-certs\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-4chsh\" (UID: \"714239fc-8cc6-4c75-9b43-331de350552f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:45:11.758519 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.758501    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/714239fc-8cc6-4c75-9b43-331de350552f-maas-api-tls\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-4chsh\" (UID: \"714239fc-8cc6-4c75-9b43-331de350552f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:45:11.758581 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.758551    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/714239fc-8cc6-4c75-9b43-331de350552f-openshift-service-ca\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-4chsh\" (UID: \"714239fc-8cc6-4c75-9b43-331de350552f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:45:11.771668 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.771640    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-49c123d1-serving-cert\""
Nov 03 17:45:11.860044 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.860012    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvtxh\" (UniqueName: \"kubernetes.io/projected/714239fc-8cc6-4c75-9b43-331de350552f-kube-api-access-lvtxh\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-4chsh\" (UID: \"714239fc-8cc6-4c75-9b43-331de350552f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:45:11.860220 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.860112    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/714239fc-8cc6-4c75-9b43-331de350552f-metrics-certs\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-4chsh\" (UID: \"714239fc-8cc6-4c75-9b43-331de350552f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:45:11.860220 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.860208    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/714239fc-8cc6-4c75-9b43-331de350552f-maas-api-tls\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-4chsh\" (UID: \"714239fc-8cc6-4c75-9b43-331de350552f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:45:11.860220 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.860262    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/714239fc-8cc6-4c75-9b43-331de350552f-openshift-service-ca\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-4chsh\" (UID: \"714239fc-8cc6-4c75-9b43-331de350552f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:45:11.860456 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:45:11.860294    5021 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-serving-cert: secret "maas-api-e2e-mt-49c123d1-serving-cert" not found
Nov 03 17:45:11.860456 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:45:11.860378    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714239fc-8cc6-4c75-9b43-331de350552f-maas-api-tls podName:714239fc-8cc6-4c75-9b43-331de350552f nodeName:}" failed. No retries permitted until 2026-11-03 17:45:12.360358117 +0000 UTC m=+1712.561696160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/714239fc-8cc6-4c75-9b43-331de350552f-maas-api-tls") pod "maas-api-e2e-mt-49c123d1-85fb5898db-4chsh" (UID: "714239fc-8cc6-4c75-9b43-331de350552f") : secret "maas-api-e2e-mt-49c123d1-serving-cert" not found
Nov 03 17:45:11.860886 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.860862    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/714239fc-8cc6-4c75-9b43-331de350552f-openshift-service-ca\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-4chsh\" (UID: \"714239fc-8cc6-4c75-9b43-331de350552f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:45:11.862510 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.862489    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/714239fc-8cc6-4c75-9b43-331de350552f-metrics-certs\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-4chsh\" (UID: \"714239fc-8cc6-4c75-9b43-331de350552f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:45:11.926397 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:11.926328    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvtxh\" (UniqueName: \"kubernetes.io/projected/714239fc-8cc6-4c75-9b43-331de350552f-kube-api-access-lvtxh\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-4chsh\" (UID: \"714239fc-8cc6-4c75-9b43-331de350552f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:45:12.367024 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:12.366983    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/714239fc-8cc6-4c75-9b43-331de350552f-maas-api-tls\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-4chsh\" (UID: \"714239fc-8cc6-4c75-9b43-331de350552f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:45:12.369553 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:12.369525    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/714239fc-8cc6-4c75-9b43-331de350552f-maas-api-tls\") pod \"maas-api-e2e-mt-49c123d1-85fb5898db-4chsh\" (UID: \"714239fc-8cc6-4c75-9b43-331de350552f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:45:12.583493 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:12.583447    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:45:12.981164 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:12.978987    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"]
Nov 03 17:45:12.984542 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:45:12.984509    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod714239fc_8cc6_4c75_9b43_331de350552f.slice/crio-63a6a08eb192515fb67a2ebeaff50c5eac60fe91b9c8bca2a0e95f21645c73c3 WatchSource:0}: Error finding container 63a6a08eb192515fb67a2ebeaff50c5eac60fe91b9c8bca2a0e95f21645c73c3: Status 404 returned error can't find the container with id 63a6a08eb192515fb67a2ebeaff50c5eac60fe91b9c8bca2a0e95f21645c73c3
Nov 03 17:45:12.986400 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:12.986376    5021 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 17:45:13.068756 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:13.068715    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh" event={"ID":"714239fc-8cc6-4c75-9b43-331de350552f","Type":"ContainerStarted","Data":"63a6a08eb192515fb67a2ebeaff50c5eac60fe91b9c8bca2a0e95f21645c73c3"}
Nov 03 17:45:14.077614 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:14.077561    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh" event={"ID":"714239fc-8cc6-4c75-9b43-331de350552f","Type":"ContainerStarted","Data":"9b5095fb0010ba3afbe57b907a228ac9721694ef6e929230a3335be8c98fb0ac"}
Nov 03 17:45:14.078017 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:14.077640    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:45:14.238664 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:14.238562    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh" podStartSLOduration=2.2878248660000002 podStartE2EDuration="3.23854724s" totalImagesPullingTime="950.722374ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:45:14.234500363 +0000 UTC m=+1714.435838427" watchObservedRunningTime="2026-11-03 17:45:14.23854724 +0000 UTC m=+1714.439885292"
Nov 03 17:45:20.113681 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:45:20.113652    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:45:37.046257 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:45:37.046196    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:46:07.046625 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:46:07.046588    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:46:31.054760 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:31.054729    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"]
Nov 03 17:46:31.057403 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:31.054932    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj" podUID="1533139a-853a-4ca5-9c43-494ae9b29681" containerName="istio-proxy" containerID="cri-o://b6861d99d43a480c2a062ae5ed3605d0aad1e400c01131a89580aade54791e61" gracePeriod=30
Nov 03 17:46:34.284123 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:34.284088    5021 patch_prober.go:29] interesting pod/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 17:46:34.284591 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:34.284146    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj" podUID="1533139a-853a-4ca5-9c43-494ae9b29681" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 17:46:36.326170 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.326101    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:46:36.453590 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.453553    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-workload-certs\") pod \"1533139a-853a-4ca5-9c43-494ae9b29681\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") "
Nov 03 17:46:36.453789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.453622    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1533139a-853a-4ca5-9c43-494ae9b29681-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1533139a-853a-4ca5-9c43-494ae9b29681-istiod-ca-cert\") pod \"1533139a-853a-4ca5-9c43-494ae9b29681\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") "
Nov 03 17:46:36.453789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.453664    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1533139a-853a-4ca5-9c43-494ae9b29681-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1533139a-853a-4ca5-9c43-494ae9b29681-istio-podinfo\") pod \"1533139a-853a-4ca5-9c43-494ae9b29681\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") "
Nov 03 17:46:36.453789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.453720    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-credential-socket\") pod \"1533139a-853a-4ca5-9c43-494ae9b29681\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") "
Nov 03 17:46:36.453981 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.453801    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-istio-envoy\") pod \"1533139a-853a-4ca5-9c43-494ae9b29681\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") "
Nov 03 17:46:36.453981 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.453896    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-workload-certs" pod "1533139a-853a-4ca5-9c43-494ae9b29681" (UID: "1533139a-853a-4ca5-9c43-494ae9b29681"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:46:36.453981 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.453969    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-workload-socket\") pod \"1533139a-853a-4ca5-9c43-494ae9b29681\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") "
Nov 03 17:46:36.454140 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.453998    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1533139a-853a-4ca5-9c43-494ae9b29681-kube-api-access-xpmrm\" (UniqueName: \"kubernetes.io/projected/1533139a-853a-4ca5-9c43-494ae9b29681-kube-api-access-xpmrm\") pod \"1533139a-853a-4ca5-9c43-494ae9b29681\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") "
Nov 03 17:46:36.454140 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.454064    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1533139a-853a-4ca5-9c43-494ae9b29681-istio-token\" (UniqueName: \"kubernetes.io/projected/1533139a-853a-4ca5-9c43-494ae9b29681-istio-token\") pod \"1533139a-853a-4ca5-9c43-494ae9b29681\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") "
Nov 03 17:46:36.454140 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.454092    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-istio-data\") pod \"1533139a-853a-4ca5-9c43-494ae9b29681\" (UID: \"1533139a-853a-4ca5-9c43-494ae9b29681\") "
Nov 03 17:46:36.454379 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.454089    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-credential-socket" pod "1533139a-853a-4ca5-9c43-494ae9b29681" (UID: "1533139a-853a-4ca5-9c43-494ae9b29681"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:46:36.454455 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.454122    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1533139a-853a-4ca5-9c43-494ae9b29681-istiod-ca-cert" pod "1533139a-853a-4ca5-9c43-494ae9b29681" (UID: "1533139a-853a-4ca5-9c43-494ae9b29681"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:46:36.454455 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.454285    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-workload-socket" pod "1533139a-853a-4ca5-9c43-494ae9b29681" (UID: "1533139a-853a-4ca5-9c43-494ae9b29681"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:46:36.454455 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.454350    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-istio-data" pod "1533139a-853a-4ca5-9c43-494ae9b29681" (UID: "1533139a-853a-4ca5-9c43-494ae9b29681"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:46:36.454618 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.454557    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:46:36.454618 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.454569    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:46:36.454618 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.454579    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:46:36.454618 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.454588    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:46:36.454618 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.454603    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1533139a-853a-4ca5-9c43-494ae9b29681-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:46:36.456043 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.456017    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-istio-envoy" pod "1533139a-853a-4ca5-9c43-494ae9b29681" (UID: "1533139a-853a-4ca5-9c43-494ae9b29681"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:46:36.456304 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.456286    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1533139a-853a-4ca5-9c43-494ae9b29681-istio-token" pod "1533139a-853a-4ca5-9c43-494ae9b29681" (UID: "1533139a-853a-4ca5-9c43-494ae9b29681"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:46:36.456422 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.456402    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1533139a-853a-4ca5-9c43-494ae9b29681-kube-api-access-xpmrm" pod "1533139a-853a-4ca5-9c43-494ae9b29681" (UID: "1533139a-853a-4ca5-9c43-494ae9b29681"). InnerVolumeSpecName "kube-api-access-xpmrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:46:36.456740 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.456713    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1533139a-853a-4ca5-9c43-494ae9b29681-istio-podinfo" pod "1533139a-853a-4ca5-9c43-494ae9b29681" (UID: "1533139a-853a-4ca5-9c43-494ae9b29681"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 17:46:36.556024 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.555993    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1533139a-853a-4ca5-9c43-494ae9b29681-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:46:36.556024 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.556023    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpmrm\" (UniqueName: \"kubernetes.io/projected/1533139a-853a-4ca5-9c43-494ae9b29681-kube-api-access-xpmrm\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:46:36.556208 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.556034    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1533139a-853a-4ca5-9c43-494ae9b29681-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:46:36.556208 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.556045    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1533139a-853a-4ca5-9c43-494ae9b29681-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:46:36.661178 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.661088    5021 generic.go:356] "Generic (PLEG): container finished" podID="1533139a-853a-4ca5-9c43-494ae9b29681" containerID="b6861d99d43a480c2a062ae5ed3605d0aad1e400c01131a89580aade54791e61" exitCode=0
Nov 03 17:46:36.661178 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.661147    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"
Nov 03 17:46:36.661441 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.661174    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj" event={"ID":"1533139a-853a-4ca5-9c43-494ae9b29681","Type":"ContainerDied","Data":"b6861d99d43a480c2a062ae5ed3605d0aad1e400c01131a89580aade54791e61"}
Nov 03 17:46:36.661441 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.661319    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj" event={"ID":"1533139a-853a-4ca5-9c43-494ae9b29681","Type":"ContainerDied","Data":"8d73e5f6eafc0be834f466645eacc62cde9a210f7a7576776924da561044e2de"}
Nov 03 17:46:36.661441 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.661359    5021 scope.go:122] "RemoveContainer" containerID="b6861d99d43a480c2a062ae5ed3605d0aad1e400c01131a89580aade54791e61"
Nov 03 17:46:36.675728 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.675711    5021 scope.go:122] "RemoveContainer" containerID="b6861d99d43a480c2a062ae5ed3605d0aad1e400c01131a89580aade54791e61"
Nov 03 17:46:36.676053 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:46:36.676023    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6861d99d43a480c2a062ae5ed3605d0aad1e400c01131a89580aade54791e61\": container with ID starting with b6861d99d43a480c2a062ae5ed3605d0aad1e400c01131a89580aade54791e61 not found: ID does not exist" containerID="b6861d99d43a480c2a062ae5ed3605d0aad1e400c01131a89580aade54791e61"
Nov 03 17:46:36.676113 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.676065    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6861d99d43a480c2a062ae5ed3605d0aad1e400c01131a89580aade54791e61"} err="failed to get container status \"b6861d99d43a480c2a062ae5ed3605d0aad1e400c01131a89580aade54791e61\": rpc error: code = NotFound desc = could not find container \"b6861d99d43a480c2a062ae5ed3605d0aad1e400c01131a89580aade54791e61\": container with ID starting with b6861d99d43a480c2a062ae5ed3605d0aad1e400c01131a89580aade54791e61 not found: ID does not exist"
Nov 03 17:46:36.837253 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.837207    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"]
Nov 03 17:46:36.850273 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:36.850221    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-xkckj"]
Nov 03 17:46:37.055087 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:46:37.055042    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:46:38.004452 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:38.004418    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1533139a-853a-4ca5-9c43-494ae9b29681" path="/var/lib/kubelet/pods/1533139a-853a-4ca5-9c43-494ae9b29681/volumes"
Nov 03 17:46:40.231515 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:40.231484    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:46:40.242967 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:46:40.242944    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:47:07.046111 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:47:07.046078    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:47:13.590617 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.590582    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"]
Nov 03 17:47:13.591267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.591236    5021 cpu_manager.go:414] "containerMap: removing container" podUID="1533139a-853a-4ca5-9c43-494ae9b29681" containerName="istio-proxy"
Nov 03 17:47:13.591267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.591253    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1533139a-853a-4ca5-9c43-494ae9b29681" containerName="istio-proxy"
Nov 03 17:47:13.591381 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.591371    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="1533139a-853a-4ca5-9c43-494ae9b29681" containerName="istio-proxy"
Nov 03 17:47:13.595028 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.595005    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.630700 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.630670    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-credential-socket\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.630827 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.630708    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istiod-ca-cert\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.630827 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.630736    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z55d5\" (UniqueName: \"kubernetes.io/projected/b4b88c90-269d-4cc4-a6aa-c63771b9a235-kube-api-access-z55d5\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.630905 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.630883    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-data\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.630948 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.630935    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-workload-socket\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.631054 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.631038    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-podinfo\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.631150 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.631138    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-workload-certs\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.631187 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.631164    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-envoy\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.631221 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.631192    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-token\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.691731 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.691694    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"]
Nov 03 17:47:13.710114 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.710082    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"]
Nov 03 17:47:13.710369 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.710339    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh" podUID="714239fc-8cc6-4c75-9b43-331de350552f" containerName="maas-api" containerID="cri-o://9b5095fb0010ba3afbe57b907a228ac9721694ef6e929230a3335be8c98fb0ac" gracePeriod=30
Nov 03 17:47:13.732972 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.732937    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-workload-certs\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.733122 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.732991    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-envoy\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.733122 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.733035    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-token\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.733274 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.733129    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-credential-socket\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.733274 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.733157    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istiod-ca-cert\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.733274 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.733188    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z55d5\" (UniqueName: \"kubernetes.io/projected/b4b88c90-269d-4cc4-a6aa-c63771b9a235-kube-api-access-z55d5\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.733437 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.733273    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-data\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.733437 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.733327    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-workload-socket\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.733437 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.733396    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-podinfo\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.734011 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.733984    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-credential-socket\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.734380 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.734350    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-data\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.734592 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.734572    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-workload-socket\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.734787 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.734761    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istiod-ca-cert\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.735567 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.735545    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-workload-certs\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.736350 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.736333    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-podinfo\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.737023 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.737000    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-envoy\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.805535 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.805506    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-token\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.805707 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.805644    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z55d5\" (UniqueName: \"kubernetes.io/projected/b4b88c90-269d-4cc4-a6aa-c63771b9a235-kube-api-access-z55d5\") pod \"e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") " pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.914519 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.910803    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:13.921267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.918774    5021 generic.go:356] "Generic (PLEG): container finished" podID="714239fc-8cc6-4c75-9b43-331de350552f" containerID="9b5095fb0010ba3afbe57b907a228ac9721694ef6e929230a3335be8c98fb0ac" exitCode=0
Nov 03 17:47:13.921267 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.919019    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh" event={"ID":"714239fc-8cc6-4c75-9b43-331de350552f","Type":"ContainerDied","Data":"9b5095fb0010ba3afbe57b907a228ac9721694ef6e929230a3335be8c98fb0ac"}
Nov 03 17:47:13.992002 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:13.988571    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:47:14.038579 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.037550    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/714239fc-8cc6-4c75-9b43-331de350552f-kube-api-access-lvtxh\" (UniqueName: \"kubernetes.io/projected/714239fc-8cc6-4c75-9b43-331de350552f-kube-api-access-lvtxh\") pod \"714239fc-8cc6-4c75-9b43-331de350552f\" (UID: \"714239fc-8cc6-4c75-9b43-331de350552f\") "
Nov 03 17:47:14.038579 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.037608    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/714239fc-8cc6-4c75-9b43-331de350552f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/714239fc-8cc6-4c75-9b43-331de350552f-openshift-service-ca\") pod \"714239fc-8cc6-4c75-9b43-331de350552f\" (UID: \"714239fc-8cc6-4c75-9b43-331de350552f\") "
Nov 03 17:47:14.038579 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.037703    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/714239fc-8cc6-4c75-9b43-331de350552f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/714239fc-8cc6-4c75-9b43-331de350552f-maas-api-tls\") pod \"714239fc-8cc6-4c75-9b43-331de350552f\" (UID: \"714239fc-8cc6-4c75-9b43-331de350552f\") "
Nov 03 17:47:14.038579 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.037823    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/714239fc-8cc6-4c75-9b43-331de350552f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/714239fc-8cc6-4c75-9b43-331de350552f-metrics-certs\") pod \"714239fc-8cc6-4c75-9b43-331de350552f\" (UID: \"714239fc-8cc6-4c75-9b43-331de350552f\") "
Nov 03 17:47:14.040553 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.038981    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/714239fc-8cc6-4c75-9b43-331de350552f-openshift-service-ca" pod "714239fc-8cc6-4c75-9b43-331de350552f" (UID: "714239fc-8cc6-4c75-9b43-331de350552f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:47:14.041902 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.041864    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/714239fc-8cc6-4c75-9b43-331de350552f-kube-api-access-lvtxh" pod "714239fc-8cc6-4c75-9b43-331de350552f" (UID: "714239fc-8cc6-4c75-9b43-331de350552f"). InnerVolumeSpecName "kube-api-access-lvtxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:47:14.043262 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.043093    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/714239fc-8cc6-4c75-9b43-331de350552f-maas-api-tls" pod "714239fc-8cc6-4c75-9b43-331de350552f" (UID: "714239fc-8cc6-4c75-9b43-331de350552f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:47:14.044269 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.044247    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/714239fc-8cc6-4c75-9b43-331de350552f-metrics-certs" pod "714239fc-8cc6-4c75-9b43-331de350552f" (UID: "714239fc-8cc6-4c75-9b43-331de350552f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:47:14.139368 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.139287    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/714239fc-8cc6-4c75-9b43-331de350552f-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:47:14.139368 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.139314    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvtxh\" (UniqueName: \"kubernetes.io/projected/714239fc-8cc6-4c75-9b43-331de350552f-kube-api-access-lvtxh\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:47:14.139368 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.139324    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/714239fc-8cc6-4c75-9b43-331de350552f-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:47:14.139368 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.139333    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/714239fc-8cc6-4c75-9b43-331de350552f-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:47:14.399290 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.399261    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"]
Nov 03 17:47:14.399681 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:47:14.399659    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b88c90_269d_4cc4_a6aa_c63771b9a235.slice/crio-c9f481c6ccc1309310ffe3e097eee6bf177d7e4c0af80fd8d757520d71692184 WatchSource:0}: Error finding container c9f481c6ccc1309310ffe3e097eee6bf177d7e4c0af80fd8d757520d71692184: Status 404 returned error can't find the container with id c9f481c6ccc1309310ffe3e097eee6bf177d7e4c0af80fd8d757520d71692184
Nov 03 17:47:14.402459 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.402426    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:47:14.402529 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.402491    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:47:14.402529 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.402521    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:47:14.926948 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.926898    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68" event={"ID":"b4b88c90-269d-4cc4-a6aa-c63771b9a235","Type":"ContainerStarted","Data":"4cf4645add64c2fb6b6e9fba740f6ebf02e672522019842e6fa2ce03e495f356"}
Nov 03 17:47:14.927477 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.926963    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68" event={"ID":"b4b88c90-269d-4cc4-a6aa-c63771b9a235","Type":"ContainerStarted","Data":"c9f481c6ccc1309310ffe3e097eee6bf177d7e4c0af80fd8d757520d71692184"}
Nov 03 17:47:14.928338 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.928308    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"
Nov 03 17:47:14.928470 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.928340    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh" event={"ID":"714239fc-8cc6-4c75-9b43-331de350552f","Type":"ContainerDied","Data":"63a6a08eb192515fb67a2ebeaff50c5eac60fe91b9c8bca2a0e95f21645c73c3"}
Nov 03 17:47:14.928470 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:14.928386    5021 scope.go:122] "RemoveContainer" containerID="9b5095fb0010ba3afbe57b907a228ac9721694ef6e929230a3335be8c98fb0ac"
Nov 03 17:47:15.080213 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:15.080156    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68" podStartSLOduration=2.080142046 podStartE2EDuration="2.080142046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:47:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:47:15.075738361 +0000 UTC m=+1835.277076414" watchObservedRunningTime="2026-11-03 17:47:15.080142046 +0000 UTC m=+1835.281480100"
Nov 03 17:47:15.254070 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:15.254034    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"]
Nov 03 17:47:15.257048 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:15.257024    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-49c123d1-85fb5898db-4chsh"]
Nov 03 17:47:15.911307 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:15.911261    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:15.912839 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:15.912809    5021 patch_prober.go:29] interesting pod/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Nov 03 17:47:15.913059 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:15.912866    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68" podUID="b4b88c90-269d-4cc4-a6aa-c63771b9a235" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Nov 03 17:47:16.049260 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:16.049195    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="714239fc-8cc6-4c75-9b43-331de350552f" path="/var/lib/kubelet/pods/714239fc-8cc6-4c75-9b43-331de350552f/volumes"
Nov 03 17:47:16.912520 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:16.912476    5021 patch_prober.go:29] interesting pod/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Nov 03 17:47:16.912722 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:16.912536    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68" podUID="b4b88c90-269d-4cc4-a6aa-c63771b9a235" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Nov 03 17:47:17.914651 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:17.914613    5021 patch_prober.go:29] interesting pod/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Nov 03 17:47:17.915278 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:17.915244    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68" podUID="b4b88c90-269d-4cc4-a6aa-c63771b9a235" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Nov 03 17:47:18.912454 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:18.912378    5021 patch_prober.go:29] interesting pod/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Nov 03 17:47:18.912454 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:18.912443    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68" podUID="b4b88c90-269d-4cc4-a6aa-c63771b9a235" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Nov 03 17:47:19.911890 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:19.911857    5021 patch_prober.go:29] interesting pod/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Nov 03 17:47:19.912345 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:19.911909    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68" podUID="b4b88c90-269d-4cc4-a6aa-c63771b9a235" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Nov 03 17:47:20.912560 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:20.912521    5021 patch_prober.go:29] interesting pod/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Nov 03 17:47:20.913149 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:20.912602    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68" podUID="b4b88c90-269d-4cc4-a6aa-c63771b9a235" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Nov 03 17:47:21.916019 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:21.915991    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:21.916463 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:21.916423    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:21.917159 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:21.917138    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:47:37.053282 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:47:37.053238    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:47:40.557487 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:47:40.557451    5021 scope.go:122] "RemoveContainer" containerID="2878a36fa7cdaad79040c54646f026c0ef12aa8a01175c308c6e9c3a80761973"
Nov 03 17:48:00.419468 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:00.419421    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ctxx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 17:48:00.420022 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:00.419483    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx" podUID="0ec638e1-c16b-4853-9079-7de44f5d4070" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 17:48:07.049236 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:48:07.049166    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:48:37.047379 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:48:37.047343    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:48:47.133079 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.133028    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"]
Nov 03 17:48:47.133867 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.133843    5021 cpu_manager.go:414] "containerMap: removing container" podUID="714239fc-8cc6-4c75-9b43-331de350552f" containerName="maas-api"
Nov 03 17:48:47.133971 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.133869    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="714239fc-8cc6-4c75-9b43-331de350552f" containerName="maas-api"
Nov 03 17:48:47.134076 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.134062    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="714239fc-8cc6-4c75-9b43-331de350552f" containerName="maas-api"
Nov 03 17:48:47.137935 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.137912    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.185357 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.185323    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"]
Nov 03 17:48:47.185606 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.185581    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj" podUID="6169adba-c568-4897-85e2-5a0c5b106570" containerName="istio-proxy" containerID="cri-o://8da0bc046b75424bb3c4824f9b61dd6fae12f7628bf91d88de16b494f67320df" gracePeriod=30
Nov 03 17:48:47.260126 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.260084    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-envoy\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.260317 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.260155    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-workload-certs\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.260317 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.260189    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-podinfo\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.260317 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.260266    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-credential-socket\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.260317 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.260300    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2q7t\" (UniqueName: \"kubernetes.io/projected/3e2536be-1a61-4e35-9ed6-a7934225176e-kube-api-access-z2q7t\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.260505 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.260486    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-token\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.260543 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.260530    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-data\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.260601 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.260585    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e2536be-1a61-4e35-9ed6-a7934225176e-istiod-ca-cert\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.260650 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.260619    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-workload-socket\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.263653 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.263622    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"]
Nov 03 17:48:47.361901 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.361866    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-workload-certs\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.361901 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.361905    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-podinfo\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.362137 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.361945    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-credential-socket\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.362137 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.361967    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2q7t\" (UniqueName: \"kubernetes.io/projected/3e2536be-1a61-4e35-9ed6-a7934225176e-kube-api-access-z2q7t\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.362137 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.362088    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-token\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.362137 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.362110    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-data\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.362397 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.362164    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e2536be-1a61-4e35-9ed6-a7934225176e-istiod-ca-cert\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.362397 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.362192    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-workload-socket\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.362397 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.362256    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-envoy\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.362536 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.362412    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-credential-socket\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.362536 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.362419    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-workload-certs\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.362536 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.362499    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-data\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.362683 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.362658    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-workload-socket\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.362905 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.362886    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e2536be-1a61-4e35-9ed6-a7934225176e-istiod-ca-cert\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.364424 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.364396    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-envoy\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.364532 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.364477    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-podinfo\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.425456 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.425383    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-token\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.438650 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.438612    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2q7t\" (UniqueName: \"kubernetes.io/projected/3e2536be-1a61-4e35-9ed6-a7934225176e-kube-api-access-z2q7t\") pod \"e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") " pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.451486 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.451457    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:47.896582 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.896549    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"]
Nov 03 17:48:47.897878 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:48:47.897840    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e2536be_1a61_4e35_9ed6_a7934225176e.slice/crio-6d2af1afcf635456f433d4cb8e0632dda7289f8fcd54a7279e39ee6e69274786 WatchSource:0}: Error finding container 6d2af1afcf635456f433d4cb8e0632dda7289f8fcd54a7279e39ee6e69274786: Status 404 returned error can't find the container with id 6d2af1afcf635456f433d4cb8e0632dda7289f8fcd54a7279e39ee6e69274786
Nov 03 17:48:47.903906 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.903858    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:48:47.904197 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.903957    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:48:47.904197 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:47.904008    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:48:48.756645 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:48.756559    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt" event={"ID":"3e2536be-1a61-4e35-9ed6-a7934225176e","Type":"ContainerStarted","Data":"f618ed87645451af0e38669afb67a29160547917bd71aaf60b4e88979d71e1ba"}
Nov 03 17:48:48.756645 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:48.756614    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt" event={"ID":"3e2536be-1a61-4e35-9ed6-a7934225176e","Type":"ContainerStarted","Data":"6d2af1afcf635456f433d4cb8e0632dda7289f8fcd54a7279e39ee6e69274786"}
Nov 03 17:48:48.953498 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:48.953427    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt" podStartSLOduration=1.953404471 podStartE2EDuration="1.953404471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:48:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:48:48.934633155 +0000 UTC m=+1929.135971207" watchObservedRunningTime="2026-11-03 17:48:48.953404471 +0000 UTC m=+1929.154742526"
Nov 03 17:48:49.450691 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:49.450640    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 17:48:49.451082 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:49.451035    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj" podUID="6169adba-c568-4897-85e2-5a0c5b106570" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 17:48:49.451797 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:49.451775    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:49.453539 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:49.453511    5021 patch_prober.go:29] interesting pod/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Nov 03 17:48:49.453648 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:49.453559    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt" podUID="3e2536be-1a61-4e35-9ed6-a7934225176e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Nov 03 17:48:50.452796 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:50.452755    5021 patch_prober.go:29] interesting pod/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Nov 03 17:48:50.453260 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:50.452824    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt" podUID="3e2536be-1a61-4e35-9ed6-a7934225176e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Nov 03 17:48:51.452166 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:51.452125    5021 patch_prober.go:29] interesting pod/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Nov 03 17:48:51.452383 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:51.452180    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt" podUID="3e2536be-1a61-4e35-9ed6-a7934225176e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Nov 03 17:48:52.151531 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.151496    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"]
Nov 03 17:48:52.155790 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.155767    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.243633 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.224499    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-token\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.243920 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.243891    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-workload-certs\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.244140 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.244120    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-credential-socket\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.253207 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.253174    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzxnt\" (UniqueName: \"kubernetes.io/projected/cfe27d86-502c-4112-a7d8-8877cbc7cedc-kube-api-access-fzxnt\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.254065 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.254040    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istiod-ca-cert\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.254291 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.254269    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-envoy\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.254471 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.254453    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-workload-socket\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.254773 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.254580    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-data\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.254773 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.254636    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-podinfo\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.256992 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.256969    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"]
Nov 03 17:48:52.356957 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.356374    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-data\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.357145 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.356988    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-podinfo\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.357145 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.356911    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-data\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.357145 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.357052    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-token\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.357145 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.357105    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-workload-certs\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.357520 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.357485    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-credential-socket\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.357596 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.357580    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxnt\" (UniqueName: \"kubernetes.io/projected/cfe27d86-502c-4112-a7d8-8877cbc7cedc-kube-api-access-fzxnt\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.357656 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.357609    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istiod-ca-cert\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.357656 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.357634    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-envoy\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.357806 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.357784    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-workload-certs\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.357872 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.357839    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-workload-socket\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.357952 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.357925    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-credential-socket\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.358831 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.358804    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istiod-ca-cert\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.359065 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.359045    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-workload-socket\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.360233 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.360200    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-podinfo\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.361352 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.361334    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-envoy\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.423902 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.423793    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-token\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.457752 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.450023    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzxnt\" (UniqueName: \"kubernetes.io/projected/cfe27d86-502c-4112-a7d8-8877cbc7cedc-kube-api-access-fzxnt\") pod \"e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") " pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.457752 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.456682    5021 patch_prober.go:29] interesting pod/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Nov 03 17:48:52.457752 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.456773    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt" podUID="3e2536be-1a61-4e35-9ed6-a7934225176e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Nov 03 17:48:52.469844 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.469817    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:52.478523 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.478495    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:48:52.562088 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.562055    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6169adba-c568-4897-85e2-5a0c5b106570-istio-token\" (UniqueName: \"kubernetes.io/projected/6169adba-c568-4897-85e2-5a0c5b106570-istio-token\") pod \"6169adba-c568-4897-85e2-5a0c5b106570\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") "
Nov 03 17:48:52.562306 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.562199    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6169adba-c568-4897-85e2-5a0c5b106570-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6169adba-c568-4897-85e2-5a0c5b106570-istiod-ca-cert\") pod \"6169adba-c568-4897-85e2-5a0c5b106570\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") "
Nov 03 17:48:52.562688 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.562300    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-workload-socket\") pod \"6169adba-c568-4897-85e2-5a0c5b106570\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") "
Nov 03 17:48:52.562688 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.562427    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-credential-socket\") pod \"6169adba-c568-4897-85e2-5a0c5b106570\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") "
Nov 03 17:48:52.562688 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.562549    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6169adba-c568-4897-85e2-5a0c5b106570-kube-api-access-gw499\" (UniqueName: \"kubernetes.io/projected/6169adba-c568-4897-85e2-5a0c5b106570-kube-api-access-gw499\") pod \"6169adba-c568-4897-85e2-5a0c5b106570\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") "
Nov 03 17:48:52.562688 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.562621    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-workload-socket" pod "6169adba-c568-4897-85e2-5a0c5b106570" (UID: "6169adba-c568-4897-85e2-5a0c5b106570"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:48:52.562688 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.562640    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6169adba-c568-4897-85e2-5a0c5b106570-istiod-ca-cert" pod "6169adba-c568-4897-85e2-5a0c5b106570" (UID: "6169adba-c568-4897-85e2-5a0c5b106570"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:48:52.562688 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.562632    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-workload-certs\") pod \"6169adba-c568-4897-85e2-5a0c5b106570\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") "
Nov 03 17:48:52.563037 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.562749    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6169adba-c568-4897-85e2-5a0c5b106570-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6169adba-c568-4897-85e2-5a0c5b106570-istio-podinfo\") pod \"6169adba-c568-4897-85e2-5a0c5b106570\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") "
Nov 03 17:48:52.563037 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.562804    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-istio-envoy\") pod \"6169adba-c568-4897-85e2-5a0c5b106570\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") "
Nov 03 17:48:52.563037 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.562870    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-istio-data\") pod \"6169adba-c568-4897-85e2-5a0c5b106570\" (UID: \"6169adba-c568-4897-85e2-5a0c5b106570\") "
Nov 03 17:48:52.563037 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.562910    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-credential-socket" pod "6169adba-c568-4897-85e2-5a0c5b106570" (UID: "6169adba-c568-4897-85e2-5a0c5b106570"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:48:52.563337 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.563315    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-workload-certs" pod "6169adba-c568-4897-85e2-5a0c5b106570" (UID: "6169adba-c568-4897-85e2-5a0c5b106570"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:48:52.563515 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.563491    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6169adba-c568-4897-85e2-5a0c5b106570-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:48:52.563601 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.563518    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:48:52.563601 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.563533    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:48:52.563787 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.563759    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-istio-data" pod "6169adba-c568-4897-85e2-5a0c5b106570" (UID: "6169adba-c568-4897-85e2-5a0c5b106570"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:48:52.565912 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.565148    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6169adba-c568-4897-85e2-5a0c5b106570-istio-token" pod "6169adba-c568-4897-85e2-5a0c5b106570" (UID: "6169adba-c568-4897-85e2-5a0c5b106570"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:48:52.565912 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.565881    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-istio-envoy" pod "6169adba-c568-4897-85e2-5a0c5b106570" (UID: "6169adba-c568-4897-85e2-5a0c5b106570"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:48:52.566969 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.566742    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6169adba-c568-4897-85e2-5a0c5b106570-istio-podinfo" pod "6169adba-c568-4897-85e2-5a0c5b106570" (UID: "6169adba-c568-4897-85e2-5a0c5b106570"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 17:48:52.566969 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.566817    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6169adba-c568-4897-85e2-5a0c5b106570-kube-api-access-gw499" pod "6169adba-c568-4897-85e2-5a0c5b106570" (UID: "6169adba-c568-4897-85e2-5a0c5b106570"). InnerVolumeSpecName "kube-api-access-gw499". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:48:52.668633 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.665549    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6169adba-c568-4897-85e2-5a0c5b106570-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:48:52.668633 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.665588    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw499\" (UniqueName: \"kubernetes.io/projected/6169adba-c568-4897-85e2-5a0c5b106570-kube-api-access-gw499\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:48:52.668633 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.665606    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:48:52.668633 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.665640    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6169adba-c568-4897-85e2-5a0c5b106570-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:48:52.668633 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.665656    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:48:52.668633 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.665670    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6169adba-c568-4897-85e2-5a0c5b106570-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:48:52.790783 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.790742    5021 generic.go:356] "Generic (PLEG): container finished" podID="6169adba-c568-4897-85e2-5a0c5b106570" containerID="8da0bc046b75424bb3c4824f9b61dd6fae12f7628bf91d88de16b494f67320df" exitCode=0
Nov 03 17:48:52.790957 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.790787    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"
Nov 03 17:48:52.790957 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.790817    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj" event={"ID":"6169adba-c568-4897-85e2-5a0c5b106570","Type":"ContainerDied","Data":"8da0bc046b75424bb3c4824f9b61dd6fae12f7628bf91d88de16b494f67320df"}
Nov 03 17:48:52.790957 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.790876    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj" event={"ID":"6169adba-c568-4897-85e2-5a0c5b106570","Type":"ContainerDied","Data":"61f04e87757cc019e92a30313e807ee494f8b080697a8bb1eba9369146c4de77"}
Nov 03 17:48:52.790957 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.790907    5021 scope.go:122] "RemoveContainer" containerID="8da0bc046b75424bb3c4824f9b61dd6fae12f7628bf91d88de16b494f67320df"
Nov 03 17:48:52.801390 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.801371    5021 scope.go:122] "RemoveContainer" containerID="8da0bc046b75424bb3c4824f9b61dd6fae12f7628bf91d88de16b494f67320df"
Nov 03 17:48:52.801673 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:48:52.801654    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8da0bc046b75424bb3c4824f9b61dd6fae12f7628bf91d88de16b494f67320df\": container with ID starting with 8da0bc046b75424bb3c4824f9b61dd6fae12f7628bf91d88de16b494f67320df not found: ID does not exist" containerID="8da0bc046b75424bb3c4824f9b61dd6fae12f7628bf91d88de16b494f67320df"
Nov 03 17:48:52.801767 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.801679    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8da0bc046b75424bb3c4824f9b61dd6fae12f7628bf91d88de16b494f67320df"} err="failed to get container status \"8da0bc046b75424bb3c4824f9b61dd6fae12f7628bf91d88de16b494f67320df\": rpc error: code = NotFound desc = could not find container \"8da0bc046b75424bb3c4824f9b61dd6fae12f7628bf91d88de16b494f67320df\": container with ID starting with 8da0bc046b75424bb3c4824f9b61dd6fae12f7628bf91d88de16b494f67320df not found: ID does not exist"
Nov 03 17:48:52.954114 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.954057    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"]
Nov 03 17:48:52.954638 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:48:52.954608    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe27d86_502c_4112_a7d8_8877cbc7cedc.slice/crio-e32f7c6047d3579145dbbac37232991c2a08a2089b16644316c72b52cbfe7223 WatchSource:0}: Error finding container e32f7c6047d3579145dbbac37232991c2a08a2089b16644316c72b52cbfe7223: Status 404 returned error can't find the container with id e32f7c6047d3579145dbbac37232991c2a08a2089b16644316c72b52cbfe7223
Nov 03 17:48:52.957300 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.957265    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:48:52.957407 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.957345    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:48:52.957407 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.957389    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:48:52.965089 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.965057    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"]
Nov 03 17:48:52.971074 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:52.971054    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-tgtvj"]
Nov 03 17:48:53.452738 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:53.452639    5021 patch_prober.go:29] interesting pod/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Nov 03 17:48:53.452738 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:53.452707    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt" podUID="3e2536be-1a61-4e35-9ed6-a7934225176e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Nov 03 17:48:53.806291 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:53.804530    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct" event={"ID":"cfe27d86-502c-4112-a7d8-8877cbc7cedc","Type":"ContainerStarted","Data":"0801047f4d1928ecce25ca3da9a37f2ccf3f863eff651fb245a4656f40128a7a"}
Nov 03 17:48:53.806291 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:53.804600    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct" event={"ID":"cfe27d86-502c-4112-a7d8-8877cbc7cedc","Type":"ContainerStarted","Data":"e32f7c6047d3579145dbbac37232991c2a08a2089b16644316c72b52cbfe7223"}
Nov 03 17:48:53.949250 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:53.948751    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct" podStartSLOduration=1.948728029 podStartE2EDuration="1.948728029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:48:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:48:53.945415584 +0000 UTC m=+1934.146753745" watchObservedRunningTime="2026-11-03 17:48:53.948728029 +0000 UTC m=+1934.150066083"
Nov 03 17:48:54.004566 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:54.004534    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6169adba-c568-4897-85e2-5a0c5b106570" path="/var/lib/kubelet/pods/6169adba-c568-4897-85e2-5a0c5b106570/volumes"
Nov 03 17:48:54.452662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:54.452621    5021 patch_prober.go:29] interesting pod/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Nov 03 17:48:54.452847 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:54.452693    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt" podUID="3e2536be-1a61-4e35-9ed6-a7934225176e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Nov 03 17:48:54.470860 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:54.470828    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:48:54.472482 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:54.472456    5021 patch_prober.go:29] interesting pod/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Nov 03 17:48:54.472591 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:54.472502    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct" podUID="cfe27d86-502c-4112-a7d8-8877cbc7cedc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Nov 03 17:48:55.457169 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:55.457130    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:55.458380 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:55.458148    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:55.459869 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:55.459833    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:48:55.471275 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:55.471244    5021 patch_prober.go:29] interesting pod/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Nov 03 17:48:55.471451 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:55.471307    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct" podUID="cfe27d86-502c-4112-a7d8-8877cbc7cedc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Nov 03 17:48:56.470965 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:56.470928    5021 patch_prober.go:29] interesting pod/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Nov 03 17:48:56.471442 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:56.470982    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct" podUID="cfe27d86-502c-4112-a7d8-8877cbc7cedc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Nov 03 17:48:57.470360 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:57.470325    5021 patch_prober.go:29] interesting pod/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Nov 03 17:48:57.470538 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:57.470382    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct" podUID="cfe27d86-502c-4112-a7d8-8877cbc7cedc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Nov 03 17:48:58.470539 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:58.470505    5021 patch_prober.go:29] interesting pod/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Nov 03 17:48:58.470956 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:58.470565    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct" podUID="cfe27d86-502c-4112-a7d8-8877cbc7cedc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Nov 03 17:48:59.470492 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:59.470455    5021 patch_prober.go:29] interesting pod/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Nov 03 17:48:59.470673 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:48:59.470507    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct" podUID="cfe27d86-502c-4112-a7d8-8877cbc7cedc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Nov 03 17:49:00.154792 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:00.154742    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"]
Nov 03 17:49:00.265046 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:00.265012    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"]
Nov 03 17:49:00.475574 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:00.475499    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:49:00.475973 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:00.475796    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:49:00.476540 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:00.476520    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:49:05.157338 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:05.157287    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p" podUID="946f62e8-f954-4cdf-b832-dcbe9962a294" containerName="payload-processing" containerID="cri-o://819289051bab245278d2f31a7f32eb42e8b0cd2b30e54c16498687ca20455f41" gracePeriod=25
Nov 03 17:49:05.265487 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:05.265420    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2" podUID="9817c092-c573-42b5-a7ad-84b4881f365d" containerName="payload-pre-processing" containerID="cri-o://68f8bde758924ad1bbd0688e13f33b941d31804983f9dd67737df4348d1f1111" gracePeriod=25
Nov 03 17:49:07.203427 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:49:07.203353    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:49:07.483447 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:07.483047    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2" podUID="9817c092-c573-42b5-a7ad-84b4881f365d" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:49:08.468823 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:08.468777    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p" podUID="946f62e8-f954-4cdf-b832-dcbe9962a294" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:49:12.588207 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:12.588170    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"]
Nov 03 17:49:12.588687 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:12.588422    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5" podUID="2b724546-821d-4460-a332-272c8b04c729" containerName="maas-api" containerID="cri-o://3461d243bc902a59fd2e94b5173145065026d30179b804c96eb6a34d42270504" gracePeriod=30
Nov 03 17:49:12.894709 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:12.894682    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:49:12.974739 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:12.974686    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2b724546-821d-4460-a332-272c8b04c729-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b724546-821d-4460-a332-272c8b04c729-maas-api-tls\") pod \"2b724546-821d-4460-a332-272c8b04c729\" (UID: \"2b724546-821d-4460-a332-272c8b04c729\") "
Nov 03 17:49:12.974944 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:12.974822    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2b724546-821d-4460-a332-272c8b04c729-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b724546-821d-4460-a332-272c8b04c729-metrics-certs\") pod \"2b724546-821d-4460-a332-272c8b04c729\" (UID: \"2b724546-821d-4460-a332-272c8b04c729\") "
Nov 03 17:49:12.974944 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:12.974905    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b724546-821d-4460-a332-272c8b04c729-kube-api-access-bl4wl\" (UniqueName: \"kubernetes.io/projected/2b724546-821d-4460-a332-272c8b04c729-kube-api-access-bl4wl\") pod \"2b724546-821d-4460-a332-272c8b04c729\" (UID: \"2b724546-821d-4460-a332-272c8b04c729\") "
Nov 03 17:49:12.975088 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:12.974978    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2b724546-821d-4460-a332-272c8b04c729-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b724546-821d-4460-a332-272c8b04c729-openshift-service-ca\") pod \"2b724546-821d-4460-a332-272c8b04c729\" (UID: \"2b724546-821d-4460-a332-272c8b04c729\") "
Nov 03 17:49:12.976066 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:12.976037    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b724546-821d-4460-a332-272c8b04c729-openshift-service-ca" pod "2b724546-821d-4460-a332-272c8b04c729" (UID: "2b724546-821d-4460-a332-272c8b04c729"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:49:12.977956 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:12.977920    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b724546-821d-4460-a332-272c8b04c729-kube-api-access-bl4wl" pod "2b724546-821d-4460-a332-272c8b04c729" (UID: "2b724546-821d-4460-a332-272c8b04c729"). InnerVolumeSpecName "kube-api-access-bl4wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:49:12.978603 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:12.978581    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b724546-821d-4460-a332-272c8b04c729-maas-api-tls" pod "2b724546-821d-4460-a332-272c8b04c729" (UID: "2b724546-821d-4460-a332-272c8b04c729"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:49:12.978824 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:12.978798    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b724546-821d-4460-a332-272c8b04c729-metrics-certs" pod "2b724546-821d-4460-a332-272c8b04c729" (UID: "2b724546-821d-4460-a332-272c8b04c729"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:49:13.049177 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:13.049140    5021 generic.go:356] "Generic (PLEG): container finished" podID="2b724546-821d-4460-a332-272c8b04c729" containerID="3461d243bc902a59fd2e94b5173145065026d30179b804c96eb6a34d42270504" exitCode=0
Nov 03 17:49:13.049359 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:13.049191    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"
Nov 03 17:49:13.049359 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:13.049215    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5" event={"ID":"2b724546-821d-4460-a332-272c8b04c729","Type":"ContainerDied","Data":"3461d243bc902a59fd2e94b5173145065026d30179b804c96eb6a34d42270504"}
Nov 03 17:49:13.049359 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:13.049298    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5" event={"ID":"2b724546-821d-4460-a332-272c8b04c729","Type":"ContainerDied","Data":"d9647c44c81d48b98af99f70ad69307cac04bc6a32d23216ca7445d9c4c3511d"}
Nov 03 17:49:13.049359 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:13.049324    5021 scope.go:122] "RemoveContainer" containerID="3461d243bc902a59fd2e94b5173145065026d30179b804c96eb6a34d42270504"
Nov 03 17:49:13.062048 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:13.062024    5021 scope.go:122] "RemoveContainer" containerID="3461d243bc902a59fd2e94b5173145065026d30179b804c96eb6a34d42270504"
Nov 03 17:49:13.062388 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:49:13.062364    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3461d243bc902a59fd2e94b5173145065026d30179b804c96eb6a34d42270504\": container with ID starting with 3461d243bc902a59fd2e94b5173145065026d30179b804c96eb6a34d42270504 not found: ID does not exist" containerID="3461d243bc902a59fd2e94b5173145065026d30179b804c96eb6a34d42270504"
Nov 03 17:49:13.062489 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:13.062399    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3461d243bc902a59fd2e94b5173145065026d30179b804c96eb6a34d42270504"} err="failed to get container status \"3461d243bc902a59fd2e94b5173145065026d30179b804c96eb6a34d42270504\": rpc error: code = NotFound desc = could not find container \"3461d243bc902a59fd2e94b5173145065026d30179b804c96eb6a34d42270504\": container with ID starting with 3461d243bc902a59fd2e94b5173145065026d30179b804c96eb6a34d42270504 not found: ID does not exist"
Nov 03 17:49:13.076346 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:13.076315    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b724546-821d-4460-a332-272c8b04c729-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:13.076346 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:13.076345    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl4wl\" (UniqueName: \"kubernetes.io/projected/2b724546-821d-4460-a332-272c8b04c729-kube-api-access-bl4wl\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:13.076521 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:13.076362    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b724546-821d-4460-a332-272c8b04c729-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:13.076521 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:13.076375    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b724546-821d-4460-a332-272c8b04c729-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:13.223107 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:13.223007    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"]
Nov 03 17:49:13.226965 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:13.226940    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-687fb3-7744db78b8-5krt5"]
Nov 03 17:49:14.003240 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:14.003190    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b724546-821d-4460-a332-272c8b04c729" path="/var/lib/kubelet/pods/2b724546-821d-4460-a332-272c8b04c729/volumes"
Nov 03 17:49:17.463653 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:17.462957    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2" podUID="9817c092-c573-42b5-a7ad-84b4881f365d" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:49:18.468474 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:18.468439    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p" podUID="946f62e8-f954-4cdf-b832-dcbe9962a294" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:49:25.373886 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:25.373856    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"
Nov 03 17:49:25.439749 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:25.439716    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/946f62e8-f954-4cdf-b832-dcbe9962a294-kube-api-access-kvsbd\" (UniqueName: \"kubernetes.io/projected/946f62e8-f954-4cdf-b832-dcbe9962a294-kube-api-access-kvsbd\") pod \"946f62e8-f954-4cdf-b832-dcbe9962a294\" (UID: \"946f62e8-f954-4cdf-b832-dcbe9962a294\") "
Nov 03 17:49:25.440020 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:25.439996    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/946f62e8-f954-4cdf-b832-dcbe9962a294-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/946f62e8-f954-4cdf-b832-dcbe9962a294-plugins-config-volume\") pod \"946f62e8-f954-4cdf-b832-dcbe9962a294\" (UID: \"946f62e8-f954-4cdf-b832-dcbe9962a294\") "
Nov 03 17:49:25.440401 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:25.440372    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/946f62e8-f954-4cdf-b832-dcbe9962a294-plugins-config-volume" pod "946f62e8-f954-4cdf-b832-dcbe9962a294" (UID: "946f62e8-f954-4cdf-b832-dcbe9962a294"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:49:25.440489 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:25.440459    5021 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/946f62e8-f954-4cdf-b832-dcbe9962a294-plugins-config-volume\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:25.441935 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:25.441907    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/946f62e8-f954-4cdf-b832-dcbe9962a294-kube-api-access-kvsbd" pod "946f62e8-f954-4cdf-b832-dcbe9962a294" (UID: "946f62e8-f954-4cdf-b832-dcbe9962a294"). InnerVolumeSpecName "kube-api-access-kvsbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:49:25.463138 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:25.463116    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"
Nov 03 17:49:25.541481 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:25.541448    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9817c092-c573-42b5-a7ad-84b4881f365d-kube-api-access-984bv\" (UniqueName: \"kubernetes.io/projected/9817c092-c573-42b5-a7ad-84b4881f365d-kube-api-access-984bv\") pod \"9817c092-c573-42b5-a7ad-84b4881f365d\" (UID: \"9817c092-c573-42b5-a7ad-84b4881f365d\") "
Nov 03 17:49:25.541675 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:25.541531    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9817c092-c573-42b5-a7ad-84b4881f365d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9817c092-c573-42b5-a7ad-84b4881f365d-plugins-config-volume\") pod \"9817c092-c573-42b5-a7ad-84b4881f365d\" (UID: \"9817c092-c573-42b5-a7ad-84b4881f365d\") "
Nov 03 17:49:25.541849 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:25.541836    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvsbd\" (UniqueName: \"kubernetes.io/projected/946f62e8-f954-4cdf-b832-dcbe9962a294-kube-api-access-kvsbd\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:25.542009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:25.541980    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9817c092-c573-42b5-a7ad-84b4881f365d-plugins-config-volume" pod "9817c092-c573-42b5-a7ad-84b4881f365d" (UID: "9817c092-c573-42b5-a7ad-84b4881f365d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:49:25.543623 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:25.543600    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9817c092-c573-42b5-a7ad-84b4881f365d-kube-api-access-984bv" pod "9817c092-c573-42b5-a7ad-84b4881f365d" (UID: "9817c092-c573-42b5-a7ad-84b4881f365d"). InnerVolumeSpecName "kube-api-access-984bv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:49:25.643004 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:25.642963    5021 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9817c092-c573-42b5-a7ad-84b4881f365d-plugins-config-volume\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:25.643004 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:25.642995    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-984bv\" (UniqueName: \"kubernetes.io/projected/9817c092-c573-42b5-a7ad-84b4881f365d-kube-api-access-984bv\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:26.137981 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.137944    5021 generic.go:356] "Generic (PLEG): container finished" podID="9817c092-c573-42b5-a7ad-84b4881f365d" containerID="68f8bde758924ad1bbd0688e13f33b941d31804983f9dd67737df4348d1f1111" exitCode=0
Nov 03 17:49:26.138214 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.137989    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"
Nov 03 17:49:26.138214 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.138028    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2" event={"ID":"9817c092-c573-42b5-a7ad-84b4881f365d","Type":"ContainerDied","Data":"68f8bde758924ad1bbd0688e13f33b941d31804983f9dd67737df4348d1f1111"}
Nov 03 17:49:26.138214 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.138091    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2" event={"ID":"9817c092-c573-42b5-a7ad-84b4881f365d","Type":"ContainerDied","Data":"2ea35ec8e5a309fe498c08e7975eff42412d4b8f67e33ff14d261b0468a769e3"}
Nov 03 17:49:26.138214 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.138122    5021 scope.go:122] "RemoveContainer" containerID="68f8bde758924ad1bbd0688e13f33b941d31804983f9dd67737df4348d1f1111"
Nov 03 17:49:26.142116 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.140832    5021 generic.go:356] "Generic (PLEG): container finished" podID="946f62e8-f954-4cdf-b832-dcbe9962a294" containerID="819289051bab245278d2f31a7f32eb42e8b0cd2b30e54c16498687ca20455f41" exitCode=0
Nov 03 17:49:26.142116 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.141015    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p" event={"ID":"946f62e8-f954-4cdf-b832-dcbe9962a294","Type":"ContainerDied","Data":"819289051bab245278d2f31a7f32eb42e8b0cd2b30e54c16498687ca20455f41"}
Nov 03 17:49:26.142116 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.141056    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p" event={"ID":"946f62e8-f954-4cdf-b832-dcbe9962a294","Type":"ContainerDied","Data":"a1ba3fd2bfbe251a5824f74cc00517b4063bb5f4eec4b01aa296324cff9e6858"}
Nov 03 17:49:26.142116 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.141135    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"
Nov 03 17:49:26.159608 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.159569    5021 scope.go:122] "RemoveContainer" containerID="68f8bde758924ad1bbd0688e13f33b941d31804983f9dd67737df4348d1f1111"
Nov 03 17:49:26.160153 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:49:26.160129    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68f8bde758924ad1bbd0688e13f33b941d31804983f9dd67737df4348d1f1111\": container with ID starting with 68f8bde758924ad1bbd0688e13f33b941d31804983f9dd67737df4348d1f1111 not found: ID does not exist" containerID="68f8bde758924ad1bbd0688e13f33b941d31804983f9dd67737df4348d1f1111"
Nov 03 17:49:26.160610 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.160162    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68f8bde758924ad1bbd0688e13f33b941d31804983f9dd67737df4348d1f1111"} err="failed to get container status \"68f8bde758924ad1bbd0688e13f33b941d31804983f9dd67737df4348d1f1111\": rpc error: code = NotFound desc = could not find container \"68f8bde758924ad1bbd0688e13f33b941d31804983f9dd67737df4348d1f1111\": container with ID starting with 68f8bde758924ad1bbd0688e13f33b941d31804983f9dd67737df4348d1f1111 not found: ID does not exist"
Nov 03 17:49:26.160610 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.160183    5021 scope.go:122] "RemoveContainer" containerID="819289051bab245278d2f31a7f32eb42e8b0cd2b30e54c16498687ca20455f41"
Nov 03 17:49:26.171702 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.171681    5021 scope.go:122] "RemoveContainer" containerID="819289051bab245278d2f31a7f32eb42e8b0cd2b30e54c16498687ca20455f41"
Nov 03 17:49:26.172092 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:49:26.172064    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"819289051bab245278d2f31a7f32eb42e8b0cd2b30e54c16498687ca20455f41\": container with ID starting with 819289051bab245278d2f31a7f32eb42e8b0cd2b30e54c16498687ca20455f41 not found: ID does not exist" containerID="819289051bab245278d2f31a7f32eb42e8b0cd2b30e54c16498687ca20455f41"
Nov 03 17:49:26.172199 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.172101    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"819289051bab245278d2f31a7f32eb42e8b0cd2b30e54c16498687ca20455f41"} err="failed to get container status \"819289051bab245278d2f31a7f32eb42e8b0cd2b30e54c16498687ca20455f41\": rpc error: code = NotFound desc = could not find container \"819289051bab245278d2f31a7f32eb42e8b0cd2b30e54c16498687ca20455f41\": container with ID starting with 819289051bab245278d2f31a7f32eb42e8b0cd2b30e54c16498687ca20455f41 not found: ID does not exist"
Nov 03 17:49:26.312172 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.312045    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"]
Nov 03 17:49:26.362060 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.362029    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-687fb3-596d5d4b5f-rvb4p"]
Nov 03 17:49:26.429173 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.429142    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"]
Nov 03 17:49:26.433628 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.433589    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-687fb3-77dfd78b7-k4jm2"]
Nov 03 17:49:26.930298 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.911327    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"]
Nov 03 17:49:26.930298 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.911568    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w" podUID="31cf4b70-4b18-4711-aedd-31bf4c9a987f" containerName="istio-proxy" containerID="cri-o://ce0064fff29383172740d61a4cbd681e2873b6addbf8c592e939e92795db9946" gracePeriod=30
Nov 03 17:49:26.930298 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.913582    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"]
Nov 03 17:49:26.930298 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:26.913781    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s" podUID="a2de9f7c-8a08-4b83-af23-04ef58ff5739" containerName="istio-proxy" containerID="cri-o://f87eb028d9be4ac4323e6f079b1b479231d31efa272da295171d39ab87b17d24" gracePeriod=30
Nov 03 17:49:28.003956 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:28.003918    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="946f62e8-f954-4cdf-b832-dcbe9962a294" path="/var/lib/kubelet/pods/946f62e8-f954-4cdf-b832-dcbe9962a294/volumes"
Nov 03 17:49:28.004408 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:28.004336    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9817c092-c573-42b5-a7ad-84b4881f365d" path="/var/lib/kubelet/pods/9817c092-c573-42b5-a7ad-84b4881f365d/volumes"
Nov 03 17:49:32.191797 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.191703    5021 generic.go:356] "Generic (PLEG): container finished" podID="a2de9f7c-8a08-4b83-af23-04ef58ff5739" containerID="f87eb028d9be4ac4323e6f079b1b479231d31efa272da295171d39ab87b17d24" exitCode=0
Nov 03 17:49:32.192258 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.191775    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s" event={"ID":"a2de9f7c-8a08-4b83-af23-04ef58ff5739","Type":"ContainerDied","Data":"f87eb028d9be4ac4323e6f079b1b479231d31efa272da295171d39ab87b17d24"}
Nov 03 17:49:32.194170 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.194140    5021 generic.go:356] "Generic (PLEG): container finished" podID="31cf4b70-4b18-4711-aedd-31bf4c9a987f" containerID="ce0064fff29383172740d61a4cbd681e2873b6addbf8c592e939e92795db9946" exitCode=0
Nov 03 17:49:32.194576 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.194335    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w" event={"ID":"31cf4b70-4b18-4711-aedd-31bf4c9a987f","Type":"ContainerDied","Data":"ce0064fff29383172740d61a4cbd681e2873b6addbf8c592e939e92795db9946"}
Nov 03 17:49:32.215527 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.215500    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:49:32.235406 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.235385    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:49:32.353557 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.353526    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-token\" (UniqueName: \"kubernetes.io/projected/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-token\") pod \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") "
Nov 03 17:49:32.353728 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.353581    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-credential-socket\") pod \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") "
Nov 03 17:49:32.353728 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.353622    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-workload-socket\") pod \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") "
Nov 03 17:49:32.353728 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.353660    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-podinfo\") pod \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") "
Nov 03 17:49:32.353728 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.353689    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istiod-ca-cert\") pod \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") "
Nov 03 17:49:32.353728 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.353715    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istiod-ca-cert\") pod \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") "
Nov 03 17:49:32.353996 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.353769    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a2de9f7c-8a08-4b83-af23-04ef58ff5739-kube-api-access-jtg7l\" (UniqueName: \"kubernetes.io/projected/a2de9f7c-8a08-4b83-af23-04ef58ff5739-kube-api-access-jtg7l\") pod \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") "
Nov 03 17:49:32.353996 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.353799    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-data\") pod \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") "
Nov 03 17:49:32.353996 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.353824    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-workload-certs\") pod \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") "
Nov 03 17:49:32.353996 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.353864    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-workload-socket\") pod \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") "
Nov 03 17:49:32.353996 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.353891    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-podinfo\") pod \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") "
Nov 03 17:49:32.353996 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.353912    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-workload-socket" pod "31cf4b70-4b18-4711-aedd-31bf4c9a987f" (UID: "31cf4b70-4b18-4711-aedd-31bf4c9a987f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:49:32.353996 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.353925    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-credential-socket" pod "31cf4b70-4b18-4711-aedd-31bf4c9a987f" (UID: "31cf4b70-4b18-4711-aedd-31bf4c9a987f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:49:32.353996 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.353962    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-envoy\") pod \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") "
Nov 03 17:49:32.354442 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.354018    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-credential-socket\") pod \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") "
Nov 03 17:49:32.354442 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.354089    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31cf4b70-4b18-4711-aedd-31bf4c9a987f-kube-api-access-9vl86\" (UniqueName: \"kubernetes.io/projected/31cf4b70-4b18-4711-aedd-31bf4c9a987f-kube-api-access-9vl86\") pod \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") "
Nov 03 17:49:32.354442 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.354108    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-workload-certs" pod "31cf4b70-4b18-4711-aedd-31bf4c9a987f" (UID: "31cf4b70-4b18-4711-aedd-31bf4c9a987f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:49:32.354442 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.354124    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-data\") pod \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") "
Nov 03 17:49:32.354442 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.354163    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-workload-certs\") pod \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\" (UID: \"a2de9f7c-8a08-4b83-af23-04ef58ff5739\") "
Nov 03 17:49:32.354442 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.354166    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istiod-ca-cert" pod "31cf4b70-4b18-4711-aedd-31bf4c9a987f" (UID: "31cf4b70-4b18-4711-aedd-31bf4c9a987f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:49:32.354442 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.354209    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-token\" (UniqueName: \"kubernetes.io/projected/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-token\") pod \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") "
Nov 03 17:49:32.354442 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.354259    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-data" pod "a2de9f7c-8a08-4b83-af23-04ef58ff5739" (UID: "a2de9f7c-8a08-4b83-af23-04ef58ff5739"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:49:32.354442 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.354271    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-envoy\") pod \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\" (UID: \"31cf4b70-4b18-4711-aedd-31bf4c9a987f\") "
Nov 03 17:49:32.354887 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.354698    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istiod-ca-cert" pod "a2de9f7c-8a08-4b83-af23-04ef58ff5739" (UID: "a2de9f7c-8a08-4b83-af23-04ef58ff5739"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:49:32.354972 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.354944    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-workload-socket" pod "a2de9f7c-8a08-4b83-af23-04ef58ff5739" (UID: "a2de9f7c-8a08-4b83-af23-04ef58ff5739"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:49:32.354972 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.354955    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-workload-certs" pod "a2de9f7c-8a08-4b83-af23-04ef58ff5739" (UID: "a2de9f7c-8a08-4b83-af23-04ef58ff5739"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:49:32.355091 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.355021    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-data" pod "31cf4b70-4b18-4711-aedd-31bf4c9a987f" (UID: "31cf4b70-4b18-4711-aedd-31bf4c9a987f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:49:32.355183 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.355162    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-credential-socket" pod "a2de9f7c-8a08-4b83-af23-04ef58ff5739" (UID: "a2de9f7c-8a08-4b83-af23-04ef58ff5739"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:49:32.355667 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.355633    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:32.355781 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.355674    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:32.355781 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.355692    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:32.355781 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.355707    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:32.355781 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.355722    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:32.355781 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.355736    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:32.355781 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.355751    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:32.355781 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.355765    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:32.355781 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.355779    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:32.356299 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.355795    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:32.356370 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.356349    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-podinfo" pod "a2de9f7c-8a08-4b83-af23-04ef58ff5739" (UID: "a2de9f7c-8a08-4b83-af23-04ef58ff5739"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 17:49:32.356692 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.356654    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-envoy" pod "a2de9f7c-8a08-4b83-af23-04ef58ff5739" (UID: "a2de9f7c-8a08-4b83-af23-04ef58ff5739"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:49:32.356861 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.356826    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2de9f7c-8a08-4b83-af23-04ef58ff5739-kube-api-access-jtg7l" pod "a2de9f7c-8a08-4b83-af23-04ef58ff5739" (UID: "a2de9f7c-8a08-4b83-af23-04ef58ff5739"). InnerVolumeSpecName "kube-api-access-jtg7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:49:32.356972 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.356888    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-token" pod "a2de9f7c-8a08-4b83-af23-04ef58ff5739" (UID: "a2de9f7c-8a08-4b83-af23-04ef58ff5739"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:49:32.357112 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.357096    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31cf4b70-4b18-4711-aedd-31bf4c9a987f-kube-api-access-9vl86" pod "31cf4b70-4b18-4711-aedd-31bf4c9a987f" (UID: "31cf4b70-4b18-4711-aedd-31bf4c9a987f"). InnerVolumeSpecName "kube-api-access-9vl86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:49:32.357283 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.357265    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-envoy" pod "31cf4b70-4b18-4711-aedd-31bf4c9a987f" (UID: "31cf4b70-4b18-4711-aedd-31bf4c9a987f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:49:32.357905 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.357884    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-podinfo" pod "31cf4b70-4b18-4711-aedd-31bf4c9a987f" (UID: "31cf4b70-4b18-4711-aedd-31bf4c9a987f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 17:49:32.357957 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.357918    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-token" pod "31cf4b70-4b18-4711-aedd-31bf4c9a987f" (UID: "31cf4b70-4b18-4711-aedd-31bf4c9a987f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:49:32.457487 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.457410    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:32.457487 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.457437    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:32.457487 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.457447    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtg7l\" (UniqueName: \"kubernetes.io/projected/a2de9f7c-8a08-4b83-af23-04ef58ff5739-kube-api-access-jtg7l\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:32.457487 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.457456    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:32.457487 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.457466    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2de9f7c-8a08-4b83-af23-04ef58ff5739-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:32.457487 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.457476    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vl86\" (UniqueName: \"kubernetes.io/projected/31cf4b70-4b18-4711-aedd-31bf4c9a987f-kube-api-access-9vl86\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:32.457487 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.457484    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:32.457487 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:32.457493    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31cf4b70-4b18-4711-aedd-31bf4c9a987f-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:49:33.202164 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:33.202126    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s" event={"ID":"a2de9f7c-8a08-4b83-af23-04ef58ff5739","Type":"ContainerDied","Data":"c6b56188594901fc3de429f2d9b9fa1413f15f73d0f6df94c56e9d7ece0c7e1b"}
Nov 03 17:49:33.202583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:33.202193    5021 scope.go:122] "RemoveContainer" containerID="f87eb028d9be4ac4323e6f079b1b479231d31efa272da295171d39ab87b17d24"
Nov 03 17:49:33.202583 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:33.202141    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"
Nov 03 17:49:33.203670 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:33.203647    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"
Nov 03 17:49:33.203743 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:33.203686    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w" event={"ID":"31cf4b70-4b18-4711-aedd-31bf4c9a987f","Type":"ContainerDied","Data":"89d0abcfe94fe04a7b497a01bc676bc649345dfff03c3fcd2f5a7a282ffc16a4"}
Nov 03 17:49:33.214694 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:33.214670    5021 scope.go:122] "RemoveContainer" containerID="ce0064fff29383172740d61a4cbd681e2873b6addbf8c592e939e92795db9946"
Nov 03 17:49:33.375900 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:33.375867    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"]
Nov 03 17:49:33.427687 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:33.427654    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-8zb4w"]
Nov 03 17:49:33.494693 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:33.494611    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"]
Nov 03 17:49:33.502430 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:33.502391    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-687fb3-openshift-default-67f5489557-nnr8s"]
Nov 03 17:49:34.003710 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:34.003672    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="31cf4b70-4b18-4711-aedd-31bf4c9a987f" path="/var/lib/kubelet/pods/31cf4b70-4b18-4711-aedd-31bf4c9a987f/volumes"
Nov 03 17:49:34.004239 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:49:34.004207    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a2de9f7c-8a08-4b83-af23-04ef58ff5739" path="/var/lib/kubelet/pods/a2de9f7c-8a08-4b83-af23-04ef58ff5739/volumes"
Nov 03 17:49:37.046905 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:49:37.046860    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:50:07.046629 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:50:07.046590    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:50:37.045794 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:50:37.045751    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:51:07.046483 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:51:07.046442    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:51:37.045926 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:51:37.045888    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:51:37.991412 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.991374    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"]
Nov 03 17:51:37.992149 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992125    5021 cpu_manager.go:414] "containerMap: removing container" podUID="31cf4b70-4b18-4711-aedd-31bf4c9a987f" containerName="istio-proxy"
Nov 03 17:51:37.992149 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992148    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="31cf4b70-4b18-4711-aedd-31bf4c9a987f" containerName="istio-proxy"
Nov 03 17:51:37.992364 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992169    5021 cpu_manager.go:414] "containerMap: removing container" podUID="9817c092-c573-42b5-a7ad-84b4881f365d" containerName="payload-pre-processing"
Nov 03 17:51:37.992364 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992176    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9817c092-c573-42b5-a7ad-84b4881f365d" containerName="payload-pre-processing"
Nov 03 17:51:37.992364 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992195    5021 cpu_manager.go:414] "containerMap: removing container" podUID="2b724546-821d-4460-a332-272c8b04c729" containerName="maas-api"
Nov 03 17:51:37.992364 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992203    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2b724546-821d-4460-a332-272c8b04c729" containerName="maas-api"
Nov 03 17:51:37.992364 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992221    5021 cpu_manager.go:414] "containerMap: removing container" podUID="6169adba-c568-4897-85e2-5a0c5b106570" containerName="istio-proxy"
Nov 03 17:51:37.992364 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992244    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6169adba-c568-4897-85e2-5a0c5b106570" containerName="istio-proxy"
Nov 03 17:51:37.992364 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992270    5021 cpu_manager.go:414] "containerMap: removing container" podUID="946f62e8-f954-4cdf-b832-dcbe9962a294" containerName="payload-processing"
Nov 03 17:51:37.992364 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992277    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="946f62e8-f954-4cdf-b832-dcbe9962a294" containerName="payload-processing"
Nov 03 17:51:37.992364 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992295    5021 cpu_manager.go:414] "containerMap: removing container" podUID="a2de9f7c-8a08-4b83-af23-04ef58ff5739" containerName="istio-proxy"
Nov 03 17:51:37.992364 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992302    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a2de9f7c-8a08-4b83-af23-04ef58ff5739" containerName="istio-proxy"
Nov 03 17:51:37.992835 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992442    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="946f62e8-f954-4cdf-b832-dcbe9962a294" containerName="payload-processing"
Nov 03 17:51:37.992835 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992458    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="9817c092-c573-42b5-a7ad-84b4881f365d" containerName="payload-pre-processing"
Nov 03 17:51:37.992835 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992472    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="a2de9f7c-8a08-4b83-af23-04ef58ff5739" containerName="istio-proxy"
Nov 03 17:51:37.992835 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992485    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="2b724546-821d-4460-a332-272c8b04c729" containerName="maas-api"
Nov 03 17:51:37.992835 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992502    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="6169adba-c568-4897-85e2-5a0c5b106570" containerName="istio-proxy"
Nov 03 17:51:37.992835 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.992514    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="31cf4b70-4b18-4711-aedd-31bf4c9a987f" containerName="istio-proxy"
Nov 03 17:51:37.996204 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:37.996175    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.045322 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.045291    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-data\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.045490 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.045347    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-credential-socket\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.045490 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.045419    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-envoy\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.045578 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.045525    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ff82716-8419-4b5e-8551-7bcd37365a31-istiod-ca-cert\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.045636 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.045577    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-token\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.045636 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.045602    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-workload-certs\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.045720 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.045699    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppmnw\" (UniqueName: \"kubernetes.io/projected/3ff82716-8419-4b5e-8551-7bcd37365a31-kube-api-access-ppmnw\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.045781 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.045767    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-podinfo\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.045819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.045793    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-workload-socket\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.047658 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.047639    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-e095fe-openshift-default-dockercfg-lcjc7\""
Nov 03 17:51:38.114697 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.114663    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"]
Nov 03 17:51:38.147193 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.147138    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-envoy\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.147411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.147239    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ff82716-8419-4b5e-8551-7bcd37365a31-istiod-ca-cert\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.147411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.147273    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-token\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.147411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.147294    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-workload-certs\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.147411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.147326    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppmnw\" (UniqueName: \"kubernetes.io/projected/3ff82716-8419-4b5e-8551-7bcd37365a31-kube-api-access-ppmnw\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.147411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.147401    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-podinfo\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.147697 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.147428    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-workload-socket\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.147697 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.147492    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-data\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.147697 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.147550    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-credential-socket\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.147865 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.147701    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-workload-certs\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.147925 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.147898    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-credential-socket\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.148149 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.148093    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-workload-socket\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.148149 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.148135    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-data\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.148337 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.148126    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ff82716-8419-4b5e-8551-7bcd37365a31-istiod-ca-cert\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.149619 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.149595    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-envoy\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.150163 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.150143    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-podinfo\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.207891 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.207851    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-token\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.208134 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.208109    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppmnw\" (UniqueName: \"kubernetes.io/projected/3ff82716-8419-4b5e-8551-7bcd37365a31-kube-api-access-ppmnw\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.310468 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.310428    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:38.743354 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.743156    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"]
Nov 03 17:51:38.748181 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:51:38.748154    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff82716_8419_4b5e_8551_7bcd37365a31.slice/crio-529b4894278b4713a20f5a2b55cbebb6047f0434da47e4debd41c71fcc7c49bb WatchSource:0}: Error finding container 529b4894278b4713a20f5a2b55cbebb6047f0434da47e4debd41c71fcc7c49bb: Status 404 returned error can't find the container with id 529b4894278b4713a20f5a2b55cbebb6047f0434da47e4debd41c71fcc7c49bb
Nov 03 17:51:38.750718 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.750683    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:51:38.750801 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.750750    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:51:38.750801 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:38.750776    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:51:39.087602 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:39.087542    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg" event={"ID":"3ff82716-8419-4b5e-8551-7bcd37365a31","Type":"ContainerStarted","Data":"27b3e45b14e24babd2bbe8e1de07262fcbb541ddd57d78eb8354c1f8f8528383"}
Nov 03 17:51:39.088423 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:39.088387    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg" event={"ID":"3ff82716-8419-4b5e-8551-7bcd37365a31","Type":"ContainerStarted","Data":"529b4894278b4713a20f5a2b55cbebb6047f0434da47e4debd41c71fcc7c49bb"}
Nov 03 17:51:39.228630 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:39.228567    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg" podStartSLOduration=2.228548531 podStartE2EDuration="2.228548531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:51:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:51:39.224568807 +0000 UTC m=+2099.425906858" watchObservedRunningTime="2026-11-03 17:51:39.228548531 +0000 UTC m=+2099.429886587"
Nov 03 17:51:39.310930 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:39.310896    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:39.312811 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:39.312781    5021 patch_prober.go:29] interesting pod/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Nov 03 17:51:39.312943 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:39.312826    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg" podUID="3ff82716-8419-4b5e-8551-7bcd37365a31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Nov 03 17:51:40.282540 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:40.282512    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:51:40.285067 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:40.285037    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:51:40.311293 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:40.311266    5021 patch_prober.go:29] interesting pod/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Nov 03 17:51:40.311424 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:40.311312    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg" podUID="3ff82716-8419-4b5e-8551-7bcd37365a31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Nov 03 17:51:41.310993 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:41.310957    5021 patch_prober.go:29] interesting pod/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Nov 03 17:51:41.311419 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:41.311011    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg" podUID="3ff82716-8419-4b5e-8551-7bcd37365a31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Nov 03 17:51:42.311546 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:42.311505    5021 patch_prober.go:29] interesting pod/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Nov 03 17:51:42.312077 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:42.311581    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg" podUID="3ff82716-8419-4b5e-8551-7bcd37365a31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Nov 03 17:51:43.311755 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:43.311715    5021 patch_prober.go:29] interesting pod/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Nov 03 17:51:43.312201 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:43.311793    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg" podUID="3ff82716-8419-4b5e-8551-7bcd37365a31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Nov 03 17:51:44.311435 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:44.311397    5021 patch_prober.go:29] interesting pod/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Nov 03 17:51:44.311623 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:44.311456    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg" podUID="3ff82716-8419-4b5e-8551-7bcd37365a31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Nov 03 17:51:45.316458 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:45.316427    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:45.316926 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:45.316907    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:51:45.317682 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:51:45.317665    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:52:07.046371 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:52:07.046290    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:52:23.368465 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.368432    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"]
Nov 03 17:52:23.372888 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.372863    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.418602 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.418567    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-istio-envoy\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.418602 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.418606    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cff818c4-007c-46a3-a372-fd2c790e849b-istiod-ca-cert\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.418826 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.418740    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-istio-data\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.418826 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.418785    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-credential-socket\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.418935 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.418831    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cff818c4-007c-46a3-a372-fd2c790e849b-istio-token\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.418994 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.418936    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-workload-socket\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.418994 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.418973    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cff818c4-007c-46a3-a372-fd2c790e849b-istio-podinfo\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.419101 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.419052    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf7ft\" (UniqueName: \"kubernetes.io/projected/cff818c4-007c-46a3-a372-fd2c790e849b-kube-api-access-hf7ft\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.419270 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.419252    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-workload-certs\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.462548 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.462510    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"]
Nov 03 17:52:23.520791 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.520755    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-workload-certs\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.520966 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.520814    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-istio-envoy\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.520966 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.520840    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cff818c4-007c-46a3-a372-fd2c790e849b-istiod-ca-cert\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.520966 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.520897    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-istio-data\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.520966 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.520926    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-credential-socket\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.520966 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.520962    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cff818c4-007c-46a3-a372-fd2c790e849b-istio-token\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.521221 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.520993    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-workload-socket\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.521221 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.521026    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cff818c4-007c-46a3-a372-fd2c790e849b-istio-podinfo\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.521221 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.521078    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf7ft\" (UniqueName: \"kubernetes.io/projected/cff818c4-007c-46a3-a372-fd2c790e849b-kube-api-access-hf7ft\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.521427 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.521277    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-workload-certs\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.521427 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.521375    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-istio-data\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.521551 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.521527    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-workload-socket\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.521609 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.521551    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-credential-socket\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.521920 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.521904    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cff818c4-007c-46a3-a372-fd2c790e849b-istiod-ca-cert\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.523143 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.523124    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-istio-envoy\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.523543 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.523524    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cff818c4-007c-46a3-a372-fd2c790e849b-istio-podinfo\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.580558 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.580523    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cff818c4-007c-46a3-a372-fd2c790e849b-istio-token\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.580792 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.580673    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf7ft\" (UniqueName: \"kubernetes.io/projected/cff818c4-007c-46a3-a372-fd2c790e849b-kube-api-access-hf7ft\") pod \"e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") " pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:23.686979 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:23.686889    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:24.127151 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:24.127112    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"]
Nov 03 17:52:24.133007 ip-10-0-137-219 kubenswrapper[5021]: W1103 17:52:24.132979    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff818c4_007c_46a3_a372_fd2c790e849b.slice/crio-0e806c094c1fe233b6e4f02e1128a935abdf389b1f85cca2b0fd0458a04fc9a1 WatchSource:0}: Error finding container 0e806c094c1fe233b6e4f02e1128a935abdf389b1f85cca2b0fd0458a04fc9a1: Status 404 returned error can't find the container with id 0e806c094c1fe233b6e4f02e1128a935abdf389b1f85cca2b0fd0458a04fc9a1
Nov 03 17:52:24.135536 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:24.135502    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:52:24.135625 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:24.135569    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:52:24.135625 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:24.135598    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 17:52:24.412030 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:24.411931    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw" event={"ID":"cff818c4-007c-46a3-a372-fd2c790e849b","Type":"ContainerStarted","Data":"860585b516deff310b73c47dbe2d90c86a63dd690fdbd0f00de7fbd09a41756b"}
Nov 03 17:52:24.412030 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:24.411990    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw" event={"ID":"cff818c4-007c-46a3-a372-fd2c790e849b","Type":"ContainerStarted","Data":"0e806c094c1fe233b6e4f02e1128a935abdf389b1f85cca2b0fd0458a04fc9a1"}
Nov 03 17:52:24.546653 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:24.546596    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw" podStartSLOduration=1.546582301 podStartE2EDuration="1.546582301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 17:52:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 17:52:24.544021264 +0000 UTC m=+2144.745359329" watchObservedRunningTime="2026-11-03 17:52:24.546582301 +0000 UTC m=+2144.747920352"
Nov 03 17:52:24.687735 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:24.687646    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:25.688912 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:25.688876    5021 patch_prober.go:29] interesting pod/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Nov 03 17:52:25.689356 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:25.688943    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw" podUID="cff818c4-007c-46a3-a372-fd2c790e849b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Nov 03 17:52:26.687833 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:26.687790    5021 patch_prober.go:29] interesting pod/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Nov 03 17:52:26.688036 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:26.687855    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw" podUID="cff818c4-007c-46a3-a372-fd2c790e849b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Nov 03 17:52:27.687402 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:27.687369    5021 patch_prober.go:29] interesting pod/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Nov 03 17:52:27.687795 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:27.687428    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw" podUID="cff818c4-007c-46a3-a372-fd2c790e849b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Nov 03 17:52:28.687579 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:28.687536    5021 patch_prober.go:29] interesting pod/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Nov 03 17:52:28.687992 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:28.687607    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw" podUID="cff818c4-007c-46a3-a372-fd2c790e849b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Nov 03 17:52:29.687380 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:29.687346    5021 patch_prober.go:29] interesting pod/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Nov 03 17:52:29.687655 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:29.687404    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw" podUID="cff818c4-007c-46a3-a372-fd2c790e849b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Nov 03 17:52:30.736022 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:30.735983    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:30.736569 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:30.736543    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:30.737961 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:30.737936    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:52:30.776195 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:30.776163    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"]
Nov 03 17:52:30.776451 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:30.776408    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68" podUID="b4b88c90-269d-4cc4-a6aa-c63771b9a235" containerName="istio-proxy" containerID="cri-o://4cf4645add64c2fb6b6e9fba740f6ebf02e672522019842e6fa2ce03e495f356" gracePeriod=30
Nov 03 17:52:36.039611 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.039548    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:52:36.137095 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.137066    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-workload-socket\") pod \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") "
Nov 03 17:52:36.137292 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.137110    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4b88c90-269d-4cc4-a6aa-c63771b9a235-kube-api-access-z55d5\" (UniqueName: \"kubernetes.io/projected/b4b88c90-269d-4cc4-a6aa-c63771b9a235-kube-api-access-z55d5\") pod \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") "
Nov 03 17:52:36.137292 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.137170    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-envoy\") pod \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") "
Nov 03 17:52:36.137292 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.137202    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-token\" (UniqueName: \"kubernetes.io/projected/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-token\") pod \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") "
Nov 03 17:52:36.137292 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.137291    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-data\") pod \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") "
Nov 03 17:52:36.137541 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.137315    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-workload-certs\") pod \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") "
Nov 03 17:52:36.137541 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.137368    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-workload-socket" pod "b4b88c90-269d-4cc4-a6aa-c63771b9a235" (UID: "b4b88c90-269d-4cc4-a6aa-c63771b9a235"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:52:36.137541 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.137462    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-credential-socket\") pod \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") "
Nov 03 17:52:36.137541 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.137517    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-podinfo\") pod \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") "
Nov 03 17:52:36.137751 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.137546    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istiod-ca-cert\") pod \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\" (UID: \"b4b88c90-269d-4cc4-a6aa-c63771b9a235\") "
Nov 03 17:52:36.137751 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.137618    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-data" pod "b4b88c90-269d-4cc4-a6aa-c63771b9a235" (UID: "b4b88c90-269d-4cc4-a6aa-c63771b9a235"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:52:36.137751 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.137625    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-workload-certs" pod "b4b88c90-269d-4cc4-a6aa-c63771b9a235" (UID: "b4b88c90-269d-4cc4-a6aa-c63771b9a235"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:52:36.137912 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.137773    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-credential-socket" pod "b4b88c90-269d-4cc4-a6aa-c63771b9a235" (UID: "b4b88c90-269d-4cc4-a6aa-c63771b9a235"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:52:36.137995 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.137966    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istiod-ca-cert" pod "b4b88c90-269d-4cc4-a6aa-c63771b9a235" (UID: "b4b88c90-269d-4cc4-a6aa-c63771b9a235"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:52:36.138258 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.138216    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:52:36.138258 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.138259    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:52:36.138474 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.138271    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:52:36.138474 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.138279    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:52:36.138474 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.138288    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:52:36.139497 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.139473    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4b88c90-269d-4cc4-a6aa-c63771b9a235-kube-api-access-z55d5" pod "b4b88c90-269d-4cc4-a6aa-c63771b9a235" (UID: "b4b88c90-269d-4cc4-a6aa-c63771b9a235"). InnerVolumeSpecName "kube-api-access-z55d5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:52:36.139730 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.139707    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-envoy" pod "b4b88c90-269d-4cc4-a6aa-c63771b9a235" (UID: "b4b88c90-269d-4cc4-a6aa-c63771b9a235"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:52:36.139897 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.139875    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-podinfo" pod "b4b88c90-269d-4cc4-a6aa-c63771b9a235" (UID: "b4b88c90-269d-4cc4-a6aa-c63771b9a235"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 17:52:36.139897 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.139879    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-token" pod "b4b88c90-269d-4cc4-a6aa-c63771b9a235" (UID: "b4b88c90-269d-4cc4-a6aa-c63771b9a235"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:52:36.240139 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.240108    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:52:36.240139 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.240138    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z55d5\" (UniqueName: \"kubernetes.io/projected/b4b88c90-269d-4cc4-a6aa-c63771b9a235-kube-api-access-z55d5\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:52:36.240411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.240153    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:52:36.240411 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.240167    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4b88c90-269d-4cc4-a6aa-c63771b9a235-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:52:36.520105 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.520065    5021 generic.go:356] "Generic (PLEG): container finished" podID="b4b88c90-269d-4cc4-a6aa-c63771b9a235" containerID="4cf4645add64c2fb6b6e9fba740f6ebf02e672522019842e6fa2ce03e495f356" exitCode=0
Nov 03 17:52:36.520300 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.520115    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68" event={"ID":"b4b88c90-269d-4cc4-a6aa-c63771b9a235","Type":"ContainerDied","Data":"4cf4645add64c2fb6b6e9fba740f6ebf02e672522019842e6fa2ce03e495f356"}
Nov 03 17:52:36.520300 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.520119    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"
Nov 03 17:52:36.520300 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.520203    5021 scope.go:122] "RemoveContainer" containerID="4cf4645add64c2fb6b6e9fba740f6ebf02e672522019842e6fa2ce03e495f356"
Nov 03 17:52:36.520464 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.520191    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68" event={"ID":"b4b88c90-269d-4cc4-a6aa-c63771b9a235","Type":"ContainerDied","Data":"c9f481c6ccc1309310ffe3e097eee6bf177d7e4c0af80fd8d757520d71692184"}
Nov 03 17:52:36.531265 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.531247    5021 scope.go:122] "RemoveContainer" containerID="4cf4645add64c2fb6b6e9fba740f6ebf02e672522019842e6fa2ce03e495f356"
Nov 03 17:52:36.531498 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:52:36.531477    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cf4645add64c2fb6b6e9fba740f6ebf02e672522019842e6fa2ce03e495f356\": container with ID starting with 4cf4645add64c2fb6b6e9fba740f6ebf02e672522019842e6fa2ce03e495f356 not found: ID does not exist" containerID="4cf4645add64c2fb6b6e9fba740f6ebf02e672522019842e6fa2ce03e495f356"
Nov 03 17:52:36.531564 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.531506    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cf4645add64c2fb6b6e9fba740f6ebf02e672522019842e6fa2ce03e495f356"} err="failed to get container status \"4cf4645add64c2fb6b6e9fba740f6ebf02e672522019842e6fa2ce03e495f356\": rpc error: code = NotFound desc = could not find container \"4cf4645add64c2fb6b6e9fba740f6ebf02e672522019842e6fa2ce03e495f356\": container with ID starting with 4cf4645add64c2fb6b6e9fba740f6ebf02e672522019842e6fa2ce03e495f356 not found: ID does not exist"
Nov 03 17:52:36.691110 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.691073    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"]
Nov 03 17:52:36.694447 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:36.694419    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-cvw68"]
Nov 03 17:52:37.046156 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:52:37.046122    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:52:38.004058 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:52:38.004022    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b4b88c90-269d-4cc4-a6aa-c63771b9a235" path="/var/lib/kubelet/pods/b4b88c90-269d-4cc4-a6aa-c63771b9a235/volumes"
Nov 03 17:53:07.045848 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:53:07.045811    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:53:18.031068 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:18.031033    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"]
Nov 03 17:53:18.031527 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:18.031280    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg" podUID="3ff82716-8419-4b5e-8551-7bcd37365a31" containerName="istio-proxy" containerID="cri-o://27b3e45b14e24babd2bbe8e1de07262fcbb541ddd57d78eb8354c1f8f8528383" gracePeriod=30
Nov 03 17:53:18.051697 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:18.051663    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"]
Nov 03 17:53:18.051882 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:18.051862    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw" podUID="cff818c4-007c-46a3-a372-fd2c790e849b" containerName="istio-proxy" containerID="cri-o://860585b516deff310b73c47dbe2d90c86a63dd690fdbd0f00de7fbd09a41756b" gracePeriod=30
Nov 03 17:53:23.333135 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.333108    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:53:23.348401 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.348377    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:53:23.442586 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.442553    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-workload-certs\") pod \"cff818c4-007c-46a3-a372-fd2c790e849b\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") "
Nov 03 17:53:23.442586 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.442595    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-podinfo\") pod \"3ff82716-8419-4b5e-8551-7bcd37365a31\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") "
Nov 03 17:53:23.442819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.442616    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-token\" (UniqueName: \"kubernetes.io/projected/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-token\") pod \"3ff82716-8419-4b5e-8551-7bcd37365a31\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") "
Nov 03 17:53:23.442819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.442647    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-envoy\") pod \"3ff82716-8419-4b5e-8551-7bcd37365a31\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") "
Nov 03 17:53:23.442819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.442703    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-workload-socket\") pod \"3ff82716-8419-4b5e-8551-7bcd37365a31\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") "
Nov 03 17:53:23.442819 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.442747    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-credential-socket\") pod \"3ff82716-8419-4b5e-8551-7bcd37365a31\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") "
Nov 03 17:53:23.443016 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.442834    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-istio-envoy\") pod \"cff818c4-007c-46a3-a372-fd2c790e849b\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") "
Nov 03 17:53:23.443016 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.442901    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-data\") pod \"3ff82716-8419-4b5e-8551-7bcd37365a31\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") "
Nov 03 17:53:23.443016 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.442900    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-workload-certs" pod "cff818c4-007c-46a3-a372-fd2c790e849b" (UID: "cff818c4-007c-46a3-a372-fd2c790e849b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:53:23.443016 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.442929    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cff818c4-007c-46a3-a372-fd2c790e849b-istio-token\" (UniqueName: \"kubernetes.io/projected/cff818c4-007c-46a3-a372-fd2c790e849b-istio-token\") pod \"cff818c4-007c-46a3-a372-fd2c790e849b\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") "
Nov 03 17:53:23.443016 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.442979    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3ff82716-8419-4b5e-8551-7bcd37365a31-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ff82716-8419-4b5e-8551-7bcd37365a31-istiod-ca-cert\") pod \"3ff82716-8419-4b5e-8551-7bcd37365a31\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") "
Nov 03 17:53:23.443016 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.442991    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-workload-socket" pod "3ff82716-8419-4b5e-8551-7bcd37365a31" (UID: "3ff82716-8419-4b5e-8551-7bcd37365a31"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:53:23.443379 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.443024    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-workload-socket\") pod \"cff818c4-007c-46a3-a372-fd2c790e849b\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") "
Nov 03 17:53:23.443379 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.443067    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-credential-socket\") pod \"cff818c4-007c-46a3-a372-fd2c790e849b\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") "
Nov 03 17:53:23.443379 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.443092    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-credential-socket" pod "3ff82716-8419-4b5e-8551-7bcd37365a31" (UID: "3ff82716-8419-4b5e-8551-7bcd37365a31"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:53:23.443379 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.443124    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3ff82716-8419-4b5e-8551-7bcd37365a31-kube-api-access-ppmnw\" (UniqueName: \"kubernetes.io/projected/3ff82716-8419-4b5e-8551-7bcd37365a31-kube-api-access-ppmnw\") pod \"3ff82716-8419-4b5e-8551-7bcd37365a31\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") "
Nov 03 17:53:23.443379 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.443152    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-istio-data\") pod \"cff818c4-007c-46a3-a372-fd2c790e849b\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") "
Nov 03 17:53:23.443379 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.443215    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cff818c4-007c-46a3-a372-fd2c790e849b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cff818c4-007c-46a3-a372-fd2c790e849b-istiod-ca-cert\") pod \"cff818c4-007c-46a3-a372-fd2c790e849b\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") "
Nov 03 17:53:23.443379 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.443290    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-workload-certs\") pod \"3ff82716-8419-4b5e-8551-7bcd37365a31\" (UID: \"3ff82716-8419-4b5e-8551-7bcd37365a31\") "
Nov 03 17:53:23.443379 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.443328    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cff818c4-007c-46a3-a372-fd2c790e849b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cff818c4-007c-46a3-a372-fd2c790e849b-istio-podinfo\") pod \"cff818c4-007c-46a3-a372-fd2c790e849b\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") "
Nov 03 17:53:23.443379 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.443340    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-data" pod "3ff82716-8419-4b5e-8551-7bcd37365a31" (UID: "3ff82716-8419-4b5e-8551-7bcd37365a31"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:53:23.443379 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.443364    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cff818c4-007c-46a3-a372-fd2c790e849b-kube-api-access-hf7ft\" (UniqueName: \"kubernetes.io/projected/cff818c4-007c-46a3-a372-fd2c790e849b-kube-api-access-hf7ft\") pod \"cff818c4-007c-46a3-a372-fd2c790e849b\" (UID: \"cff818c4-007c-46a3-a372-fd2c790e849b\") "
Nov 03 17:53:23.443898 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.443477    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-credential-socket" pod "cff818c4-007c-46a3-a372-fd2c790e849b" (UID: "cff818c4-007c-46a3-a372-fd2c790e849b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:53:23.443898 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.443686    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cff818c4-007c-46a3-a372-fd2c790e849b-istiod-ca-cert" pod "cff818c4-007c-46a3-a372-fd2c790e849b" (UID: "cff818c4-007c-46a3-a372-fd2c790e849b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:53:23.443898 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.443800    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ff82716-8419-4b5e-8551-7bcd37365a31-istiod-ca-cert" pod "3ff82716-8419-4b5e-8551-7bcd37365a31" (UID: "3ff82716-8419-4b5e-8551-7bcd37365a31"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:53:23.444416 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.444080    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-workload-socket" pod "cff818c4-007c-46a3-a372-fd2c790e849b" (UID: "cff818c4-007c-46a3-a372-fd2c790e849b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:53:23.444416 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.444099    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.444416 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.444122    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ff82716-8419-4b5e-8551-7bcd37365a31-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.444416 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.444139    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.444416 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.444153    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cff818c4-007c-46a3-a372-fd2c790e849b-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.444416 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.444168    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.444416 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.444181    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.444416 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.444195    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.444416 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.444307    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-workload-certs" pod "3ff82716-8419-4b5e-8551-7bcd37365a31" (UID: "3ff82716-8419-4b5e-8551-7bcd37365a31"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:53:23.444416 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.444413    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-istio-data" pod "cff818c4-007c-46a3-a372-fd2c790e849b" (UID: "cff818c4-007c-46a3-a372-fd2c790e849b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:53:23.445440 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.445392    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-istio-envoy" pod "cff818c4-007c-46a3-a372-fd2c790e849b" (UID: "cff818c4-007c-46a3-a372-fd2c790e849b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:53:23.445670 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.445600    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cff818c4-007c-46a3-a372-fd2c790e849b-istio-token" pod "cff818c4-007c-46a3-a372-fd2c790e849b" (UID: "cff818c4-007c-46a3-a372-fd2c790e849b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:53:23.445741 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.445716    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-envoy" pod "3ff82716-8419-4b5e-8551-7bcd37365a31" (UID: "3ff82716-8419-4b5e-8551-7bcd37365a31"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:53:23.446025 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.445997    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-podinfo" pod "3ff82716-8419-4b5e-8551-7bcd37365a31" (UID: "3ff82716-8419-4b5e-8551-7bcd37365a31"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 17:53:23.446146 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.446091    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cff818c4-007c-46a3-a372-fd2c790e849b-kube-api-access-hf7ft" pod "cff818c4-007c-46a3-a372-fd2c790e849b" (UID: "cff818c4-007c-46a3-a372-fd2c790e849b"). InnerVolumeSpecName "kube-api-access-hf7ft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:53:23.446587 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.446567    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-token" pod "3ff82716-8419-4b5e-8551-7bcd37365a31" (UID: "3ff82716-8419-4b5e-8551-7bcd37365a31"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:53:23.446657 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.446585    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cff818c4-007c-46a3-a372-fd2c790e849b-istio-podinfo" pod "cff818c4-007c-46a3-a372-fd2c790e849b" (UID: "cff818c4-007c-46a3-a372-fd2c790e849b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 17:53:23.446946 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.446933    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ff82716-8419-4b5e-8551-7bcd37365a31-kube-api-access-ppmnw" pod "3ff82716-8419-4b5e-8551-7bcd37365a31" (UID: "3ff82716-8419-4b5e-8551-7bcd37365a31"). InnerVolumeSpecName "kube-api-access-ppmnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:53:23.545129 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.545093    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.545129 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.545121    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cff818c4-007c-46a3-a372-fd2c790e849b-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.545129 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.545132    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.545415 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.545142    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppmnw\" (UniqueName: \"kubernetes.io/projected/3ff82716-8419-4b5e-8551-7bcd37365a31-kube-api-access-ppmnw\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.545415 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.545152    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cff818c4-007c-46a3-a372-fd2c790e849b-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.545415 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.545161    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.545415 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.545169    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cff818c4-007c-46a3-a372-fd2c790e849b-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.545415 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.545178    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf7ft\" (UniqueName: \"kubernetes.io/projected/cff818c4-007c-46a3-a372-fd2c790e849b-kube-api-access-hf7ft\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.545415 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.545187    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.545415 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.545197    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.545415 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.545205    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ff82716-8419-4b5e-8551-7bcd37365a31-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:23.832971 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.832932    5021 generic.go:356] "Generic (PLEG): container finished" podID="cff818c4-007c-46a3-a372-fd2c790e849b" containerID="860585b516deff310b73c47dbe2d90c86a63dd690fdbd0f00de7fbd09a41756b" exitCode=0
Nov 03 17:53:23.833174 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.832985    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"
Nov 03 17:53:23.833174 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.832991    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw" event={"ID":"cff818c4-007c-46a3-a372-fd2c790e849b","Type":"ContainerDied","Data":"860585b516deff310b73c47dbe2d90c86a63dd690fdbd0f00de7fbd09a41756b"}
Nov 03 17:53:23.833174 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.833068    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw" event={"ID":"cff818c4-007c-46a3-a372-fd2c790e849b","Type":"ContainerDied","Data":"0e806c094c1fe233b6e4f02e1128a935abdf389b1f85cca2b0fd0458a04fc9a1"}
Nov 03 17:53:23.833174 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.833093    5021 scope.go:122] "RemoveContainer" containerID="860585b516deff310b73c47dbe2d90c86a63dd690fdbd0f00de7fbd09a41756b"
Nov 03 17:53:23.839563 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.839486    5021 generic.go:356] "Generic (PLEG): container finished" podID="3ff82716-8419-4b5e-8551-7bcd37365a31" containerID="27b3e45b14e24babd2bbe8e1de07262fcbb541ddd57d78eb8354c1f8f8528383" exitCode=0
Nov 03 17:53:23.839770 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.839589    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"
Nov 03 17:53:23.840073 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.839611    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg" event={"ID":"3ff82716-8419-4b5e-8551-7bcd37365a31","Type":"ContainerDied","Data":"27b3e45b14e24babd2bbe8e1de07262fcbb541ddd57d78eb8354c1f8f8528383"}
Nov 03 17:53:23.840173 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.840120    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg" event={"ID":"3ff82716-8419-4b5e-8551-7bcd37365a31","Type":"ContainerDied","Data":"529b4894278b4713a20f5a2b55cbebb6047f0434da47e4debd41c71fcc7c49bb"}
Nov 03 17:53:23.846500 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.846475    5021 scope.go:122] "RemoveContainer" containerID="860585b516deff310b73c47dbe2d90c86a63dd690fdbd0f00de7fbd09a41756b"
Nov 03 17:53:23.846845 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:53:23.846818    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"860585b516deff310b73c47dbe2d90c86a63dd690fdbd0f00de7fbd09a41756b\": container with ID starting with 860585b516deff310b73c47dbe2d90c86a63dd690fdbd0f00de7fbd09a41756b not found: ID does not exist" containerID="860585b516deff310b73c47dbe2d90c86a63dd690fdbd0f00de7fbd09a41756b"
Nov 03 17:53:23.846956 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.846859    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860585b516deff310b73c47dbe2d90c86a63dd690fdbd0f00de7fbd09a41756b"} err="failed to get container status \"860585b516deff310b73c47dbe2d90c86a63dd690fdbd0f00de7fbd09a41756b\": rpc error: code = NotFound desc = could not find container \"860585b516deff310b73c47dbe2d90c86a63dd690fdbd0f00de7fbd09a41756b\": container with ID starting with 860585b516deff310b73c47dbe2d90c86a63dd690fdbd0f00de7fbd09a41756b not found: ID does not exist"
Nov 03 17:53:23.846956 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.846884    5021 scope.go:122] "RemoveContainer" containerID="27b3e45b14e24babd2bbe8e1de07262fcbb541ddd57d78eb8354c1f8f8528383"
Nov 03 17:53:23.859414 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.859387    5021 scope.go:122] "RemoveContainer" containerID="27b3e45b14e24babd2bbe8e1de07262fcbb541ddd57d78eb8354c1f8f8528383"
Nov 03 17:53:23.859782 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:53:23.859752    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27b3e45b14e24babd2bbe8e1de07262fcbb541ddd57d78eb8354c1f8f8528383\": container with ID starting with 27b3e45b14e24babd2bbe8e1de07262fcbb541ddd57d78eb8354c1f8f8528383 not found: ID does not exist" containerID="27b3e45b14e24babd2bbe8e1de07262fcbb541ddd57d78eb8354c1f8f8528383"
Nov 03 17:53:23.859867 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.859794    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27b3e45b14e24babd2bbe8e1de07262fcbb541ddd57d78eb8354c1f8f8528383"} err="failed to get container status \"27b3e45b14e24babd2bbe8e1de07262fcbb541ddd57d78eb8354c1f8f8528383\": rpc error: code = NotFound desc = could not find container \"27b3e45b14e24babd2bbe8e1de07262fcbb541ddd57d78eb8354c1f8f8528383\": container with ID starting with 27b3e45b14e24babd2bbe8e1de07262fcbb541ddd57d78eb8354c1f8f8528383 not found: ID does not exist"
Nov 03 17:53:23.994569 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:23.994536    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"]
Nov 03 17:53:24.003159 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:24.003130    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-sfzvw"]
Nov 03 17:53:24.148305 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:24.148212    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"]
Nov 03 17:53:24.172256 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:24.172193    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-e095fe-openshift-default-59765cdb87-cbdsg"]
Nov 03 17:53:26.003627 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:26.003582    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3ff82716-8419-4b5e-8551-7bcd37365a31" path="/var/lib/kubelet/pods/3ff82716-8419-4b5e-8551-7bcd37365a31/volumes"
Nov 03 17:53:26.004272 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:26.004252    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cff818c4-007c-46a3-a372-fd2c790e849b" path="/var/lib/kubelet/pods/cff818c4-007c-46a3-a372-fd2c790e849b/volumes"
Nov 03 17:53:30.864749 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:30.864710    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"]
Nov 03 17:53:30.966442 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:30.966409    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"]
Nov 03 17:53:35.865113 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:35.865051    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn" podUID="af74c940-4933-4b51-8d80-6245266f7eb2" containerName="payload-processing" containerID="cri-o://1b906deeb9582783e62c5f3270397c91df2adf9f03ba162076a0b36d2b6b261e" gracePeriod=25
Nov 03 17:53:35.967434 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:35.967364    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv" podUID="9fee614b-4abf-47b2-9426-4938635fdf21" containerName="payload-pre-processing" containerID="cri-o://23ea4da175cb61aaa45e8261feeeb5726ac972115965090e074c30e1e1907da0" gracePeriod=25
Nov 03 17:53:36.454002 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:36.453960    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn" podUID="af74c940-4933-4b51-8d80-6245266f7eb2" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:53:36.454262 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:36.454042    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv" podUID="9fee614b-4abf-47b2-9426-4938635fdf21" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:53:37.047712 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:53:37.047673    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:53:46.454590 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:46.454543    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn" podUID="af74c940-4933-4b51-8d80-6245266f7eb2" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:53:46.455364 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:46.455324    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv" podUID="9fee614b-4abf-47b2-9426-4938635fdf21" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:53:56.057027 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.056987    5021 generic.go:356] "Generic (PLEG): container finished" podID="af74c940-4933-4b51-8d80-6245266f7eb2" containerID="1b906deeb9582783e62c5f3270397c91df2adf9f03ba162076a0b36d2b6b261e" exitCode=0
Nov 03 17:53:56.057426 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.057030    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn" event={"ID":"af74c940-4933-4b51-8d80-6245266f7eb2","Type":"ContainerDied","Data":"1b906deeb9582783e62c5f3270397c91df2adf9f03ba162076a0b36d2b6b261e"}
Nov 03 17:53:56.140685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.140626    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"
Nov 03 17:53:56.248163 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.244568    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"]
Nov 03 17:53:56.248163 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.244871    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h" podUID="0ff9164a-f56b-4cbc-a49b-9a7fb21723fd" containerName="maas-api" containerID="cri-o://1b7e4b3bd6b20d87ddd2859629369ae9261c2497aa6fa84d789519b839a9d9a9" gracePeriod=30
Nov 03 17:53:56.266885 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.266865    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"
Nov 03 17:53:56.276534 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.276503    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/af74c940-4933-4b51-8d80-6245266f7eb2-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af74c940-4933-4b51-8d80-6245266f7eb2-plugins-config-volume\") pod \"af74c940-4933-4b51-8d80-6245266f7eb2\" (UID: \"af74c940-4933-4b51-8d80-6245266f7eb2\") "
Nov 03 17:53:56.276683 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.276634    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/af74c940-4933-4b51-8d80-6245266f7eb2-kube-api-access-94zdw\" (UniqueName: \"kubernetes.io/projected/af74c940-4933-4b51-8d80-6245266f7eb2-kube-api-access-94zdw\") pod \"af74c940-4933-4b51-8d80-6245266f7eb2\" (UID: \"af74c940-4933-4b51-8d80-6245266f7eb2\") "
Nov 03 17:53:56.276882 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.276854    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af74c940-4933-4b51-8d80-6245266f7eb2-plugins-config-volume" pod "af74c940-4933-4b51-8d80-6245266f7eb2" (UID: "af74c940-4933-4b51-8d80-6245266f7eb2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:53:56.277206 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.277179    5021 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af74c940-4933-4b51-8d80-6245266f7eb2-plugins-config-volume\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:56.278780 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.278752    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af74c940-4933-4b51-8d80-6245266f7eb2-kube-api-access-94zdw" pod "af74c940-4933-4b51-8d80-6245266f7eb2" (UID: "af74c940-4933-4b51-8d80-6245266f7eb2"). InnerVolumeSpecName "kube-api-access-94zdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:53:56.378748 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.378719    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9fee614b-4abf-47b2-9426-4938635fdf21-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fee614b-4abf-47b2-9426-4938635fdf21-plugins-config-volume\") pod \"9fee614b-4abf-47b2-9426-4938635fdf21\" (UID: \"9fee614b-4abf-47b2-9426-4938635fdf21\") "
Nov 03 17:53:56.378896 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.378775    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9fee614b-4abf-47b2-9426-4938635fdf21-kube-api-access-dcpwl\" (UniqueName: \"kubernetes.io/projected/9fee614b-4abf-47b2-9426-4938635fdf21-kube-api-access-dcpwl\") pod \"9fee614b-4abf-47b2-9426-4938635fdf21\" (UID: \"9fee614b-4abf-47b2-9426-4938635fdf21\") "
Nov 03 17:53:56.379136 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.379120    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94zdw\" (UniqueName: \"kubernetes.io/projected/af74c940-4933-4b51-8d80-6245266f7eb2-kube-api-access-94zdw\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:56.379213 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.379153    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fee614b-4abf-47b2-9426-4938635fdf21-plugins-config-volume" pod "9fee614b-4abf-47b2-9426-4938635fdf21" (UID: "9fee614b-4abf-47b2-9426-4938635fdf21"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:53:56.380800 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.380772    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fee614b-4abf-47b2-9426-4938635fdf21-kube-api-access-dcpwl" pod "9fee614b-4abf-47b2-9426-4938635fdf21" (UID: "9fee614b-4abf-47b2-9426-4938635fdf21"). InnerVolumeSpecName "kube-api-access-dcpwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:53:56.480412 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.480378    5021 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fee614b-4abf-47b2-9426-4938635fdf21-plugins-config-volume\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:56.480412 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.480412    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcpwl\" (UniqueName: \"kubernetes.io/projected/9fee614b-4abf-47b2-9426-4938635fdf21-kube-api-access-dcpwl\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:56.531691 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.531662    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:53:56.682326 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.682277    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-openshift-service-ca\") pod \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\" (UID: \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\") "
Nov 03 17:53:56.682513 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.682385    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-kube-api-access-gxcr6\" (UniqueName: \"kubernetes.io/projected/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-kube-api-access-gxcr6\") pod \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\" (UID: \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\") "
Nov 03 17:53:56.682513 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.682451    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-metrics-certs\") pod \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\" (UID: \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\") "
Nov 03 17:53:56.682513 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.682507    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-maas-api-tls\") pod \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\" (UID: \"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd\") "
Nov 03 17:53:56.682711 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.682681    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-openshift-service-ca" pod "0ff9164a-f56b-4cbc-a49b-9a7fb21723fd" (UID: "0ff9164a-f56b-4cbc-a49b-9a7fb21723fd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:53:56.683016 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.682994    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:56.684586 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.684565    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-maas-api-tls" pod "0ff9164a-f56b-4cbc-a49b-9a7fb21723fd" (UID: "0ff9164a-f56b-4cbc-a49b-9a7fb21723fd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:53:56.685058 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.685030    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-metrics-certs" pod "0ff9164a-f56b-4cbc-a49b-9a7fb21723fd" (UID: "0ff9164a-f56b-4cbc-a49b-9a7fb21723fd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:53:56.685058 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.685055    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-kube-api-access-gxcr6" pod "0ff9164a-f56b-4cbc-a49b-9a7fb21723fd" (UID: "0ff9164a-f56b-4cbc-a49b-9a7fb21723fd"). InnerVolumeSpecName "kube-api-access-gxcr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:53:56.786391 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.785322    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxcr6\" (UniqueName: \"kubernetes.io/projected/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-kube-api-access-gxcr6\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:56.786391 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.785365    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:56.786391 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:56.785380    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:53:57.066416 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.066329    5021 generic.go:356] "Generic (PLEG): container finished" podID="0ff9164a-f56b-4cbc-a49b-9a7fb21723fd" containerID="1b7e4b3bd6b20d87ddd2859629369ae9261c2497aa6fa84d789519b839a9d9a9" exitCode=0
Nov 03 17:53:57.066416 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.066381    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"
Nov 03 17:53:57.066920 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.066415    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h" event={"ID":"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd","Type":"ContainerDied","Data":"1b7e4b3bd6b20d87ddd2859629369ae9261c2497aa6fa84d789519b839a9d9a9"}
Nov 03 17:53:57.066920 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.066469    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h" event={"ID":"0ff9164a-f56b-4cbc-a49b-9a7fb21723fd","Type":"ContainerDied","Data":"82854593409a468df20f89cfaca139315a4dc174b0cb6c0323dea4b36d05c6a9"}
Nov 03 17:53:57.066920 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.066485    5021 scope.go:122] "RemoveContainer" containerID="1b7e4b3bd6b20d87ddd2859629369ae9261c2497aa6fa84d789519b839a9d9a9"
Nov 03 17:53:57.068169 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.068133    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"
Nov 03 17:53:57.068319 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.068138    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn" event={"ID":"af74c940-4933-4b51-8d80-6245266f7eb2","Type":"ContainerDied","Data":"a9927d90b666f99423bd81b9fe54fffa58ef83c9091fc4a10006749a0a505ab3"}
Nov 03 17:53:57.069593 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.069572    5021 generic.go:356] "Generic (PLEG): container finished" podID="9fee614b-4abf-47b2-9426-4938635fdf21" containerID="23ea4da175cb61aaa45e8261feeeb5726ac972115965090e074c30e1e1907da0" exitCode=0
Nov 03 17:53:57.069698 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.069617    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv" event={"ID":"9fee614b-4abf-47b2-9426-4938635fdf21","Type":"ContainerDied","Data":"23ea4da175cb61aaa45e8261feeeb5726ac972115965090e074c30e1e1907da0"}
Nov 03 17:53:57.069698 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.069649    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv" event={"ID":"9fee614b-4abf-47b2-9426-4938635fdf21","Type":"ContainerDied","Data":"7ce6ee7ddc0e7a02b28829b88e24d17316572086f12a283c7a2207798fcb7928"}
Nov 03 17:53:57.069698 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.069616    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"
Nov 03 17:53:57.096516 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.086347    5021 scope.go:122] "RemoveContainer" containerID="1b7e4b3bd6b20d87ddd2859629369ae9261c2497aa6fa84d789519b839a9d9a9"
Nov 03 17:53:57.096516 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:53:57.086866    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b7e4b3bd6b20d87ddd2859629369ae9261c2497aa6fa84d789519b839a9d9a9\": container with ID starting with 1b7e4b3bd6b20d87ddd2859629369ae9261c2497aa6fa84d789519b839a9d9a9 not found: ID does not exist" containerID="1b7e4b3bd6b20d87ddd2859629369ae9261c2497aa6fa84d789519b839a9d9a9"
Nov 03 17:53:57.096516 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.087015    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b7e4b3bd6b20d87ddd2859629369ae9261c2497aa6fa84d789519b839a9d9a9"} err="failed to get container status \"1b7e4b3bd6b20d87ddd2859629369ae9261c2497aa6fa84d789519b839a9d9a9\": rpc error: code = NotFound desc = could not find container \"1b7e4b3bd6b20d87ddd2859629369ae9261c2497aa6fa84d789519b839a9d9a9\": container with ID starting with 1b7e4b3bd6b20d87ddd2859629369ae9261c2497aa6fa84d789519b839a9d9a9 not found: ID does not exist"
Nov 03 17:53:57.096516 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.087043    5021 scope.go:122] "RemoveContainer" containerID="1b906deeb9582783e62c5f3270397c91df2adf9f03ba162076a0b36d2b6b261e"
Nov 03 17:53:57.139140 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.139105    5021 scope.go:122] "RemoveContainer" containerID="23ea4da175cb61aaa45e8261feeeb5726ac972115965090e074c30e1e1907da0"
Nov 03 17:53:57.149918 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.149898    5021 scope.go:122] "RemoveContainer" containerID="23ea4da175cb61aaa45e8261feeeb5726ac972115965090e074c30e1e1907da0"
Nov 03 17:53:57.150312 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:53:57.150290    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23ea4da175cb61aaa45e8261feeeb5726ac972115965090e074c30e1e1907da0\": container with ID starting with 23ea4da175cb61aaa45e8261feeeb5726ac972115965090e074c30e1e1907da0 not found: ID does not exist" containerID="23ea4da175cb61aaa45e8261feeeb5726ac972115965090e074c30e1e1907da0"
Nov 03 17:53:57.150385 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.150323    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23ea4da175cb61aaa45e8261feeeb5726ac972115965090e074c30e1e1907da0"} err="failed to get container status \"23ea4da175cb61aaa45e8261feeeb5726ac972115965090e074c30e1e1907da0\": rpc error: code = NotFound desc = could not find container \"23ea4da175cb61aaa45e8261feeeb5726ac972115965090e074c30e1e1907da0\": container with ID starting with 23ea4da175cb61aaa45e8261feeeb5726ac972115965090e074c30e1e1907da0 not found: ID does not exist"
Nov 03 17:53:57.228699 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.228669    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"]
Nov 03 17:53:57.232913 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.232886    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-2355f4-64c4f978bc-292kn"]
Nov 03 17:53:57.389138 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.389052    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"]
Nov 03 17:53:57.394275 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.394245    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h"]
Nov 03 17:53:57.501218 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.501184    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"]
Nov 03 17:53:57.504186 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:57.504154    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-2355f4-7ddcdfb8cf-25rbv"]
Nov 03 17:53:58.004960 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:58.004921    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0ff9164a-f56b-4cbc-a49b-9a7fb21723fd" path="/var/lib/kubelet/pods/0ff9164a-f56b-4cbc-a49b-9a7fb21723fd/volumes"
Nov 03 17:53:58.005516 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:58.005498    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9fee614b-4abf-47b2-9426-4938635fdf21" path="/var/lib/kubelet/pods/9fee614b-4abf-47b2-9426-4938635fdf21/volumes"
Nov 03 17:53:58.005982 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:58.005964    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="af74c940-4933-4b51-8d80-6245266f7eb2" path="/var/lib/kubelet/pods/af74c940-4933-4b51-8d80-6245266f7eb2/volumes"
Nov 03 17:53:59.522125 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:53:59.522078    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-2355f4-59fc84dd64-tvt8h" podUID="0ff9164a-f56b-4cbc-a49b-9a7fb21723fd" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.66:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 17:54:03.479248 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:03.479196    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"]
Nov 03 17:54:03.479998 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:03.479957    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z" podUID="f8f2cfcf-bea5-4a8f-b78e-70779445cee7" containerName="istio-proxy" containerID="cri-o://b43ec9bf253bb6af7f242823a1b535491e0adeacafd7c4d9ed4c6231b83541df" gracePeriod=30
Nov 03 17:54:04.236745 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:04.236705    5021 patch_prober.go:29] interesting pod/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 17:54:04.236989 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:04.236766    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z" podUID="f8f2cfcf-bea5-4a8f-b78e-70779445cee7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 17:54:07.046469 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:54:07.046428    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:54:08.759522 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.759497    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:54:08.831430 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.831396    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-workload-socket\") pod \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") "
Nov 03 17:54:08.831590 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.831467    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-credential-socket\") pod \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") "
Nov 03 17:54:08.831590 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.831522    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-data\") pod \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") "
Nov 03 17:54:08.831590 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.831571    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-envoy\") pod \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") "
Nov 03 17:54:08.831724 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.831620    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istiod-ca-cert\") pod \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") "
Nov 03 17:54:08.831724 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.831706    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-podinfo\") pod \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") "
Nov 03 17:54:08.831808 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.831714    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-workload-socket" pod "f8f2cfcf-bea5-4a8f-b78e-70779445cee7" (UID: "f8f2cfcf-bea5-4a8f-b78e-70779445cee7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:54:08.831808 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.831752    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-kube-api-access-2tnqx\" (UniqueName: \"kubernetes.io/projected/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-kube-api-access-2tnqx\") pod \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") "
Nov 03 17:54:08.831808 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.831761    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-credential-socket" pod "f8f2cfcf-bea5-4a8f-b78e-70779445cee7" (UID: "f8f2cfcf-bea5-4a8f-b78e-70779445cee7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:54:08.831808 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.831781    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-workload-certs\") pod \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") "
Nov 03 17:54:08.832007 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.831819    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-token\" (UniqueName: \"kubernetes.io/projected/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-token\") pod \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\" (UID: \"f8f2cfcf-bea5-4a8f-b78e-70779445cee7\") "
Nov 03 17:54:08.832007 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.831914    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-data" pod "f8f2cfcf-bea5-4a8f-b78e-70779445cee7" (UID: "f8f2cfcf-bea5-4a8f-b78e-70779445cee7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:54:08.832112 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.832062    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istiod-ca-cert" pod "f8f2cfcf-bea5-4a8f-b78e-70779445cee7" (UID: "f8f2cfcf-bea5-4a8f-b78e-70779445cee7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:54:08.832112 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.832082    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-workload-certs" pod "f8f2cfcf-bea5-4a8f-b78e-70779445cee7" (UID: "f8f2cfcf-bea5-4a8f-b78e-70779445cee7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:54:08.832354 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.832331    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:08.832456 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.832358    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:08.832456 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.832372    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:08.832456 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.832384    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:08.832456 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.832397    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:08.833823 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.833802    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-envoy" pod "f8f2cfcf-bea5-4a8f-b78e-70779445cee7" (UID: "f8f2cfcf-bea5-4a8f-b78e-70779445cee7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:54:08.834085 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.834071    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-token" pod "f8f2cfcf-bea5-4a8f-b78e-70779445cee7" (UID: "f8f2cfcf-bea5-4a8f-b78e-70779445cee7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:54:08.834271 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.834254    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-kube-api-access-2tnqx" pod "f8f2cfcf-bea5-4a8f-b78e-70779445cee7" (UID: "f8f2cfcf-bea5-4a8f-b78e-70779445cee7"). InnerVolumeSpecName "kube-api-access-2tnqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:54:08.834318 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.834309    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-podinfo" pod "f8f2cfcf-bea5-4a8f-b78e-70779445cee7" (UID: "f8f2cfcf-bea5-4a8f-b78e-70779445cee7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 17:54:08.933705 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.933671    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:08.933705 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.933702    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:08.933916 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.933717    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tnqx\" (UniqueName: \"kubernetes.io/projected/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-kube-api-access-2tnqx\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:08.933916 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:08.933730    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8f2cfcf-bea5-4a8f-b78e-70779445cee7-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:09.144908 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:09.144810    5021 generic.go:356] "Generic (PLEG): container finished" podID="f8f2cfcf-bea5-4a8f-b78e-70779445cee7" containerID="b43ec9bf253bb6af7f242823a1b535491e0adeacafd7c4d9ed4c6231b83541df" exitCode=0
Nov 03 17:54:09.144908 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:09.144861    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"
Nov 03 17:54:09.144908 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:09.144892    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z" event={"ID":"f8f2cfcf-bea5-4a8f-b78e-70779445cee7","Type":"ContainerDied","Data":"b43ec9bf253bb6af7f242823a1b535491e0adeacafd7c4d9ed4c6231b83541df"}
Nov 03 17:54:09.145156 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:09.144950    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z" event={"ID":"f8f2cfcf-bea5-4a8f-b78e-70779445cee7","Type":"ContainerDied","Data":"a3bfe84b8c7440eb46cd427652f7b805632cce179dce099b1503334da1bddc24"}
Nov 03 17:54:09.145156 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:09.144973    5021 scope.go:122] "RemoveContainer" containerID="b43ec9bf253bb6af7f242823a1b535491e0adeacafd7c4d9ed4c6231b83541df"
Nov 03 17:54:09.155282 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:09.155260    5021 scope.go:122] "RemoveContainer" containerID="b43ec9bf253bb6af7f242823a1b535491e0adeacafd7c4d9ed4c6231b83541df"
Nov 03 17:54:09.155598 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:54:09.155578    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b43ec9bf253bb6af7f242823a1b535491e0adeacafd7c4d9ed4c6231b83541df\": container with ID starting with b43ec9bf253bb6af7f242823a1b535491e0adeacafd7c4d9ed4c6231b83541df not found: ID does not exist" containerID="b43ec9bf253bb6af7f242823a1b535491e0adeacafd7c4d9ed4c6231b83541df"
Nov 03 17:54:09.155661 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:09.155608    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43ec9bf253bb6af7f242823a1b535491e0adeacafd7c4d9ed4c6231b83541df"} err="failed to get container status \"b43ec9bf253bb6af7f242823a1b535491e0adeacafd7c4d9ed4c6231b83541df\": rpc error: code = NotFound desc = could not find container \"b43ec9bf253bb6af7f242823a1b535491e0adeacafd7c4d9ed4c6231b83541df\": container with ID starting with b43ec9bf253bb6af7f242823a1b535491e0adeacafd7c4d9ed4c6231b83541df not found: ID does not exist"
Nov 03 17:54:09.307791 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:09.307752    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"]
Nov 03 17:54:09.355887 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:09.355851    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-2355f4-openshift-default-578c7f7b49-fhq5z"]
Nov 03 17:54:10.004998 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:10.004965    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f8f2cfcf-bea5-4a8f-b78e-70779445cee7" path="/var/lib/kubelet/pods/f8f2cfcf-bea5-4a8f-b78e-70779445cee7/volumes"
Nov 03 17:54:34.853494 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:34.853454    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"]
Nov 03 17:54:34.854118 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:34.853682    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt" podUID="3e2536be-1a61-4e35-9ed6-a7934225176e" containerName="istio-proxy" containerID="cri-o://f618ed87645451af0e38669afb67a29160547917bd71aaf60b4e88979d71e1ba" gracePeriod=30
Nov 03 17:54:37.046275 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:54:37.046236    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:54:40.114435 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.114409    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:54:40.297701 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.297667    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-workload-certs\") pod \"3e2536be-1a61-4e35-9ed6-a7934225176e\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") "
Nov 03 17:54:40.297701 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.297712    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-data\") pod \"3e2536be-1a61-4e35-9ed6-a7934225176e\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") "
Nov 03 17:54:40.297987 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.297765    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e2536be-1a61-4e35-9ed6-a7934225176e-kube-api-access-z2q7t\" (UniqueName: \"kubernetes.io/projected/3e2536be-1a61-4e35-9ed6-a7934225176e-kube-api-access-z2q7t\") pod \"3e2536be-1a61-4e35-9ed6-a7934225176e\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") "
Nov 03 17:54:40.297987 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.297799    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-workload-socket\") pod \"3e2536be-1a61-4e35-9ed6-a7934225176e\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") "
Nov 03 17:54:40.297987 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.297817    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-podinfo\") pod \"3e2536be-1a61-4e35-9ed6-a7934225176e\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") "
Nov 03 17:54:40.297987 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.297847    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-envoy\") pod \"3e2536be-1a61-4e35-9ed6-a7934225176e\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") "
Nov 03 17:54:40.297987 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.297919    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-token\" (UniqueName: \"kubernetes.io/projected/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-token\") pod \"3e2536be-1a61-4e35-9ed6-a7934225176e\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") "
Nov 03 17:54:40.297987 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.297945    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3e2536be-1a61-4e35-9ed6-a7934225176e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e2536be-1a61-4e35-9ed6-a7934225176e-istiod-ca-cert\") pod \"3e2536be-1a61-4e35-9ed6-a7934225176e\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") "
Nov 03 17:54:40.297987 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.297983    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-credential-socket\") pod \"3e2536be-1a61-4e35-9ed6-a7934225176e\" (UID: \"3e2536be-1a61-4e35-9ed6-a7934225176e\") "
Nov 03 17:54:40.298397 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.298002    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-workload-certs" pod "3e2536be-1a61-4e35-9ed6-a7934225176e" (UID: "3e2536be-1a61-4e35-9ed6-a7934225176e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:54:40.298397 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.298083    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-data" pod "3e2536be-1a61-4e35-9ed6-a7934225176e" (UID: "3e2536be-1a61-4e35-9ed6-a7934225176e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:54:40.298397 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.298221    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-workload-socket" pod "3e2536be-1a61-4e35-9ed6-a7934225176e" (UID: "3e2536be-1a61-4e35-9ed6-a7934225176e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:54:40.298397 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.298382    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-credential-socket" pod "3e2536be-1a61-4e35-9ed6-a7934225176e" (UID: "3e2536be-1a61-4e35-9ed6-a7934225176e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:54:40.298617 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.298399    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e2536be-1a61-4e35-9ed6-a7934225176e-istiod-ca-cert" pod "3e2536be-1a61-4e35-9ed6-a7934225176e" (UID: "3e2536be-1a61-4e35-9ed6-a7934225176e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:54:40.298677 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.298621    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e2536be-1a61-4e35-9ed6-a7934225176e-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:40.298677 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.298644    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:40.298677 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.298659    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:40.298677 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.298674    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:40.298887 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.298689    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:40.300164 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.300134    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-podinfo" pod "3e2536be-1a61-4e35-9ed6-a7934225176e" (UID: "3e2536be-1a61-4e35-9ed6-a7934225176e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 17:54:40.300300 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.300180    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-envoy" pod "3e2536be-1a61-4e35-9ed6-a7934225176e" (UID: "3e2536be-1a61-4e35-9ed6-a7934225176e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:54:40.300300 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.300186    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e2536be-1a61-4e35-9ed6-a7934225176e-kube-api-access-z2q7t" pod "3e2536be-1a61-4e35-9ed6-a7934225176e" (UID: "3e2536be-1a61-4e35-9ed6-a7934225176e"). InnerVolumeSpecName "kube-api-access-z2q7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:54:40.300395 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.300362    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-token" pod "3e2536be-1a61-4e35-9ed6-a7934225176e" (UID: "3e2536be-1a61-4e35-9ed6-a7934225176e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:54:40.335079 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.335039    5021 generic.go:356] "Generic (PLEG): container finished" podID="3e2536be-1a61-4e35-9ed6-a7934225176e" containerID="f618ed87645451af0e38669afb67a29160547917bd71aaf60b4e88979d71e1ba" exitCode=0
Nov 03 17:54:40.335291 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.335107    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"
Nov 03 17:54:40.335291 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.335115    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt" event={"ID":"3e2536be-1a61-4e35-9ed6-a7934225176e","Type":"ContainerDied","Data":"f618ed87645451af0e38669afb67a29160547917bd71aaf60b4e88979d71e1ba"}
Nov 03 17:54:40.335291 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.335172    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt" event={"ID":"3e2536be-1a61-4e35-9ed6-a7934225176e","Type":"ContainerDied","Data":"6d2af1afcf635456f433d4cb8e0632dda7289f8fcd54a7279e39ee6e69274786"}
Nov 03 17:54:40.335291 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.335194    5021 scope.go:122] "RemoveContainer" containerID="f618ed87645451af0e38669afb67a29160547917bd71aaf60b4e88979d71e1ba"
Nov 03 17:54:40.347802 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.347779    5021 scope.go:122] "RemoveContainer" containerID="f618ed87645451af0e38669afb67a29160547917bd71aaf60b4e88979d71e1ba"
Nov 03 17:54:40.348137 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:54:40.348111    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f618ed87645451af0e38669afb67a29160547917bd71aaf60b4e88979d71e1ba\": container with ID starting with f618ed87645451af0e38669afb67a29160547917bd71aaf60b4e88979d71e1ba not found: ID does not exist" containerID="f618ed87645451af0e38669afb67a29160547917bd71aaf60b4e88979d71e1ba"
Nov 03 17:54:40.348256 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.348146    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f618ed87645451af0e38669afb67a29160547917bd71aaf60b4e88979d71e1ba"} err="failed to get container status \"f618ed87645451af0e38669afb67a29160547917bd71aaf60b4e88979d71e1ba\": rpc error: code = NotFound desc = could not find container \"f618ed87645451af0e38669afb67a29160547917bd71aaf60b4e88979d71e1ba\": container with ID starting with f618ed87645451af0e38669afb67a29160547917bd71aaf60b4e88979d71e1ba not found: ID does not exist"
Nov 03 17:54:40.399461 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.399432    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:40.399461 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.399459    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2q7t\" (UniqueName: \"kubernetes.io/projected/3e2536be-1a61-4e35-9ed6-a7934225176e-kube-api-access-z2q7t\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:40.399461 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.399470    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:40.399697 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.399480    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e2536be-1a61-4e35-9ed6-a7934225176e-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:54:40.495141 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.495105    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"]
Nov 03 17:54:40.499321 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:40.499284    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-hrtbt"]
Nov 03 17:54:42.006426 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:42.004903    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e2536be-1a61-4e35-9ed6-a7934225176e" path="/var/lib/kubelet/pods/3e2536be-1a61-4e35-9ed6-a7934225176e/volumes"
Nov 03 17:54:54.978724 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:54.978643    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"]
Nov 03 17:54:54.979141 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:54:54.978832    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct" podUID="cfe27d86-502c-4112-a7d8-8877cbc7cedc" containerName="istio-proxy" containerID="cri-o://0801047f4d1928ecce25ca3da9a37f2ccf3f863eff651fb245a4656f40128a7a" gracePeriod=30
Nov 03 17:55:00.245271 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.245205    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:55:00.327437 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.327402    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-token\" (UniqueName: \"kubernetes.io/projected/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-token\") pod \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") "
Nov 03 17:55:00.327437 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.327442    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-envoy\") pod \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") "
Nov 03 17:55:00.327662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.327467    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-podinfo\") pod \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") "
Nov 03 17:55:00.327662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.327498    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istiod-ca-cert\") pod \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") "
Nov 03 17:55:00.327662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.327516    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-workload-socket\") pod \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") "
Nov 03 17:55:00.327662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.327548    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-workload-certs\") pod \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") "
Nov 03 17:55:00.327662 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.327637    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cfe27d86-502c-4112-a7d8-8877cbc7cedc-kube-api-access-fzxnt\" (UniqueName: \"kubernetes.io/projected/cfe27d86-502c-4112-a7d8-8877cbc7cedc-kube-api-access-fzxnt\") pod \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") "
Nov 03 17:55:00.327912 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.327818    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-data\") pod \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") "
Nov 03 17:55:00.327912 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.327856    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-credential-socket\") pod \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\" (UID: \"cfe27d86-502c-4112-a7d8-8877cbc7cedc\") "
Nov 03 17:55:00.328033 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.327973    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istiod-ca-cert" pod "cfe27d86-502c-4112-a7d8-8877cbc7cedc" (UID: "cfe27d86-502c-4112-a7d8-8877cbc7cedc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:55:00.328033 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.327991    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-workload-certs" pod "cfe27d86-502c-4112-a7d8-8877cbc7cedc" (UID: "cfe27d86-502c-4112-a7d8-8877cbc7cedc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:55:00.328186 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.328165    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-credential-socket" pod "cfe27d86-502c-4112-a7d8-8877cbc7cedc" (UID: "cfe27d86-502c-4112-a7d8-8877cbc7cedc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:55:00.328351 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.328308    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-data" pod "cfe27d86-502c-4112-a7d8-8877cbc7cedc" (UID: "cfe27d86-502c-4112-a7d8-8877cbc7cedc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:55:00.328444 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.328346    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-workload-socket" pod "cfe27d86-502c-4112-a7d8-8877cbc7cedc" (UID: "cfe27d86-502c-4112-a7d8-8877cbc7cedc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:55:00.328444 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.328424    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:00.328444 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.328444    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:00.328575 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.328454    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:00.329895 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.329861    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-podinfo" pod "cfe27d86-502c-4112-a7d8-8877cbc7cedc" (UID: "cfe27d86-502c-4112-a7d8-8877cbc7cedc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 17:55:00.330183 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.330155    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfe27d86-502c-4112-a7d8-8877cbc7cedc-kube-api-access-fzxnt" pod "cfe27d86-502c-4112-a7d8-8877cbc7cedc" (UID: "cfe27d86-502c-4112-a7d8-8877cbc7cedc"). InnerVolumeSpecName "kube-api-access-fzxnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:55:00.330183 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.330173    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-envoy" pod "cfe27d86-502c-4112-a7d8-8877cbc7cedc" (UID: "cfe27d86-502c-4112-a7d8-8877cbc7cedc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:55:00.330367 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.330187    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-token" pod "cfe27d86-502c-4112-a7d8-8877cbc7cedc" (UID: "cfe27d86-502c-4112-a7d8-8877cbc7cedc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:55:00.430096 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.430058    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:00.430096 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.430093    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:00.430377 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.430109    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:00.430377 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.430121    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfe27d86-502c-4112-a7d8-8877cbc7cedc-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:00.430377 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.430134    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfe27d86-502c-4112-a7d8-8877cbc7cedc-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:00.430377 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.430147    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzxnt\" (UniqueName: \"kubernetes.io/projected/cfe27d86-502c-4112-a7d8-8877cbc7cedc-kube-api-access-fzxnt\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:00.456152 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.456112    5021 generic.go:356] "Generic (PLEG): container finished" podID="cfe27d86-502c-4112-a7d8-8877cbc7cedc" containerID="0801047f4d1928ecce25ca3da9a37f2ccf3f863eff651fb245a4656f40128a7a" exitCode=0
Nov 03 17:55:00.456386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.456171    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"
Nov 03 17:55:00.456386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.456206    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct" event={"ID":"cfe27d86-502c-4112-a7d8-8877cbc7cedc","Type":"ContainerDied","Data":"0801047f4d1928ecce25ca3da9a37f2ccf3f863eff651fb245a4656f40128a7a"}
Nov 03 17:55:00.456386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.456275    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct" event={"ID":"cfe27d86-502c-4112-a7d8-8877cbc7cedc","Type":"ContainerDied","Data":"e32f7c6047d3579145dbbac37232991c2a08a2089b16644316c72b52cbfe7223"}
Nov 03 17:55:00.456386 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.456308    5021 scope.go:122] "RemoveContainer" containerID="0801047f4d1928ecce25ca3da9a37f2ccf3f863eff651fb245a4656f40128a7a"
Nov 03 17:55:00.476063 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.476035    5021 scope.go:122] "RemoveContainer" containerID="0801047f4d1928ecce25ca3da9a37f2ccf3f863eff651fb245a4656f40128a7a"
Nov 03 17:55:00.476414 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:55:00.476395    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0801047f4d1928ecce25ca3da9a37f2ccf3f863eff651fb245a4656f40128a7a\": container with ID starting with 0801047f4d1928ecce25ca3da9a37f2ccf3f863eff651fb245a4656f40128a7a not found: ID does not exist" containerID="0801047f4d1928ecce25ca3da9a37f2ccf3f863eff651fb245a4656f40128a7a"
Nov 03 17:55:00.476467 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.476425    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0801047f4d1928ecce25ca3da9a37f2ccf3f863eff651fb245a4656f40128a7a"} err="failed to get container status \"0801047f4d1928ecce25ca3da9a37f2ccf3f863eff651fb245a4656f40128a7a\": rpc error: code = NotFound desc = could not find container \"0801047f4d1928ecce25ca3da9a37f2ccf3f863eff651fb245a4656f40128a7a\": container with ID starting with 0801047f4d1928ecce25ca3da9a37f2ccf3f863eff651fb245a4656f40128a7a not found: ID does not exist"
Nov 03 17:55:00.617170 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.617136    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"]
Nov 03 17:55:00.628865 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:00.628837    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-dbcct"]
Nov 03 17:55:02.003785 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:02.003746    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cfe27d86-502c-4112-a7d8-8877cbc7cedc" path="/var/lib/kubelet/pods/cfe27d86-502c-4112-a7d8-8877cbc7cedc/volumes"
Nov 03 17:55:07.046054 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:55:07.046009    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:55:10.158746 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:10.158708    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"]
Nov 03 17:55:10.159215 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:10.158930    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx" podUID="0ec638e1-c16b-4853-9079-7de44f5d4070" containerName="istio-proxy" containerID="cri-o://ac36b14e6b12774bc22ab3152aa8e9506032050a2b56bb3266424ffa4c19a0d7" gracePeriod=30
Nov 03 17:55:14.357517 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:14.357473    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7ctxx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 17:55:14.357995 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:14.357563    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx" podUID="0ec638e1-c16b-4853-9079-7de44f5d4070" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 17:55:15.426768 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.426735    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:55:15.491730 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.491651    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-token\" (UniqueName: \"kubernetes.io/projected/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-token\") pod \"0ec638e1-c16b-4853-9079-7de44f5d4070\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") "
Nov 03 17:55:15.491730 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.491704    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-envoy\") pod \"0ec638e1-c16b-4853-9079-7de44f5d4070\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") "
Nov 03 17:55:15.491951 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.491742    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-workload-socket\") pod \"0ec638e1-c16b-4853-9079-7de44f5d4070\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") "
Nov 03 17:55:15.491951 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.491806    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-podinfo\") pod \"0ec638e1-c16b-4853-9079-7de44f5d4070\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") "
Nov 03 17:55:15.491951 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.491857    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0ec638e1-c16b-4853-9079-7de44f5d4070-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ec638e1-c16b-4853-9079-7de44f5d4070-istiod-ca-cert\") pod \"0ec638e1-c16b-4853-9079-7de44f5d4070\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") "
Nov 03 17:55:15.492122 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.492005    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ec638e1-c16b-4853-9079-7de44f5d4070-kube-api-access-bqcpq\" (UniqueName: \"kubernetes.io/projected/0ec638e1-c16b-4853-9079-7de44f5d4070-kube-api-access-bqcpq\") pod \"0ec638e1-c16b-4853-9079-7de44f5d4070\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") "
Nov 03 17:55:15.492122 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.492093    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-workload-certs\") pod \"0ec638e1-c16b-4853-9079-7de44f5d4070\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") "
Nov 03 17:55:15.492252 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.492168    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-credential-socket\") pod \"0ec638e1-c16b-4853-9079-7de44f5d4070\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") "
Nov 03 17:55:15.492252 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.492207    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-data\") pod \"0ec638e1-c16b-4853-9079-7de44f5d4070\" (UID: \"0ec638e1-c16b-4853-9079-7de44f5d4070\") "
Nov 03 17:55:15.492361 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.492215    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ec638e1-c16b-4853-9079-7de44f5d4070-istiod-ca-cert" pod "0ec638e1-c16b-4853-9079-7de44f5d4070" (UID: "0ec638e1-c16b-4853-9079-7de44f5d4070"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:55:15.492591 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.492489    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-workload-socket" pod "0ec638e1-c16b-4853-9079-7de44f5d4070" (UID: "0ec638e1-c16b-4853-9079-7de44f5d4070"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:55:15.492684 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.492589    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-data" pod "0ec638e1-c16b-4853-9079-7de44f5d4070" (UID: "0ec638e1-c16b-4853-9079-7de44f5d4070"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:55:15.492861 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.492834    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:15.493004 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.492864    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:15.493004 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.492881    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ec638e1-c16b-4853-9079-7de44f5d4070-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:15.493004 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.492948    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-credential-socket" pod "0ec638e1-c16b-4853-9079-7de44f5d4070" (UID: "0ec638e1-c16b-4853-9079-7de44f5d4070"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:55:15.493194 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.493127    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-workload-certs" pod "0ec638e1-c16b-4853-9079-7de44f5d4070" (UID: "0ec638e1-c16b-4853-9079-7de44f5d4070"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:55:15.494198 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.494170    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-token" pod "0ec638e1-c16b-4853-9079-7de44f5d4070" (UID: "0ec638e1-c16b-4853-9079-7de44f5d4070"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:55:15.494325 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.494176    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ec638e1-c16b-4853-9079-7de44f5d4070-kube-api-access-bqcpq" pod "0ec638e1-c16b-4853-9079-7de44f5d4070" (UID: "0ec638e1-c16b-4853-9079-7de44f5d4070"). InnerVolumeSpecName "kube-api-access-bqcpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:55:15.494437 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.494417    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-podinfo" pod "0ec638e1-c16b-4853-9079-7de44f5d4070" (UID: "0ec638e1-c16b-4853-9079-7de44f5d4070"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 17:55:15.494519 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.494479    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-envoy" pod "0ec638e1-c16b-4853-9079-7de44f5d4070" (UID: "0ec638e1-c16b-4853-9079-7de44f5d4070"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:55:15.550065 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.550025    5021 generic.go:356] "Generic (PLEG): container finished" podID="0ec638e1-c16b-4853-9079-7de44f5d4070" containerID="ac36b14e6b12774bc22ab3152aa8e9506032050a2b56bb3266424ffa4c19a0d7" exitCode=0
Nov 03 17:55:15.550280 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.550083    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"
Nov 03 17:55:15.550280 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.550114    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx" event={"ID":"0ec638e1-c16b-4853-9079-7de44f5d4070","Type":"ContainerDied","Data":"ac36b14e6b12774bc22ab3152aa8e9506032050a2b56bb3266424ffa4c19a0d7"}
Nov 03 17:55:15.550280 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.550173    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx" event={"ID":"0ec638e1-c16b-4853-9079-7de44f5d4070","Type":"ContainerDied","Data":"ad17fb3805be23ef16c5e2577f7b0be4e5b58b1f26ad2e57bc3707dde4245568"}
Nov 03 17:55:15.550280 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.550202    5021 scope.go:122] "RemoveContainer" containerID="ac36b14e6b12774bc22ab3152aa8e9506032050a2b56bb3266424ffa4c19a0d7"
Nov 03 17:55:15.561061 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.561043    5021 scope.go:122] "RemoveContainer" containerID="ac36b14e6b12774bc22ab3152aa8e9506032050a2b56bb3266424ffa4c19a0d7"
Nov 03 17:55:15.561328 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:55:15.561307    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac36b14e6b12774bc22ab3152aa8e9506032050a2b56bb3266424ffa4c19a0d7\": container with ID starting with ac36b14e6b12774bc22ab3152aa8e9506032050a2b56bb3266424ffa4c19a0d7 not found: ID does not exist" containerID="ac36b14e6b12774bc22ab3152aa8e9506032050a2b56bb3266424ffa4c19a0d7"
Nov 03 17:55:15.561381 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.561338    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac36b14e6b12774bc22ab3152aa8e9506032050a2b56bb3266424ffa4c19a0d7"} err="failed to get container status \"ac36b14e6b12774bc22ab3152aa8e9506032050a2b56bb3266424ffa4c19a0d7\": rpc error: code = NotFound desc = could not find container \"ac36b14e6b12774bc22ab3152aa8e9506032050a2b56bb3266424ffa4c19a0d7\": container with ID starting with ac36b14e6b12774bc22ab3152aa8e9506032050a2b56bb3266424ffa4c19a0d7 not found: ID does not exist"
Nov 03 17:55:15.594265 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.594235    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:15.594265 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.594266    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqcpq\" (UniqueName: \"kubernetes.io/projected/0ec638e1-c16b-4853-9079-7de44f5d4070-kube-api-access-bqcpq\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:15.594265 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.594283    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:15.594537 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.594298    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:15.594537 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.594312    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:15.594537 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.594323    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ec638e1-c16b-4853-9079-7de44f5d4070-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:55:15.701435 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.701397    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"]
Nov 03 17:55:15.706344 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:15.706316    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ctxx"]
Nov 03 17:55:16.005891 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:55:16.005853    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0ec638e1-c16b-4853-9079-7de44f5d4070" path="/var/lib/kubelet/pods/0ec638e1-c16b-4853-9079-7de44f5d4070/volumes"
Nov 03 17:55:37.045443 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:55:37.045399    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:56:07.045851 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:56:07.045811    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:56:16.132329 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:16.132291    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"]
Nov 03 17:56:21.133164 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:21.133074    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5" podUID="4cd6d68d-3f3e-49f4-a643-39cd05d6d72e" containerName="payload-pre-processing" containerID="cri-o://c4736202aec4abf06da00eda4f1f6a946713617b7983ae68ca057fd083fa6b70" gracePeriod=25
Nov 03 17:56:22.847789 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:22.847741    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5" podUID="4cd6d68d-3f3e-49f4-a643-39cd05d6d72e" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:56:29.702000 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:29.701962    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"]
Nov 03 17:56:29.702428 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:29.702240    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br" podUID="b545b7bb-eadc-432e-aa29-c66ba01b479c" containerName="maas-api" containerID="cri-o://e63be874e63a4c68b0f1a6c59199c694bb00bb3fa4a812dd803278373c736bff" gracePeriod=30
Nov 03 17:56:29.983426 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:29.983394    5021 generic.go:356] "Generic (PLEG): container finished" podID="b545b7bb-eadc-432e-aa29-c66ba01b479c" containerID="e63be874e63a4c68b0f1a6c59199c694bb00bb3fa4a812dd803278373c736bff" exitCode=0
Nov 03 17:56:29.983572 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:29.983472    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br" event={"ID":"b545b7bb-eadc-432e-aa29-c66ba01b479c","Type":"ContainerDied","Data":"e63be874e63a4c68b0f1a6c59199c694bb00bb3fa4a812dd803278373c736bff"}
Nov 03 17:56:29.983572 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:29.983524    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br" event={"ID":"b545b7bb-eadc-432e-aa29-c66ba01b479c","Type":"ContainerDied","Data":"335303ba6480f753f44df9cb0d75c99e4950b135a35c87c72d4828490f6548ae"}
Nov 03 17:56:29.983572 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:29.983541    5021 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="335303ba6480f753f44df9cb0d75c99e4950b135a35c87c72d4828490f6548ae"
Nov 03 17:56:29.990727 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:29.990703    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:56:30.086401 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:30.086353    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b545b7bb-eadc-432e-aa29-c66ba01b479c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b545b7bb-eadc-432e-aa29-c66ba01b479c-maas-api-tls\") pod \"b545b7bb-eadc-432e-aa29-c66ba01b479c\" (UID: \"b545b7bb-eadc-432e-aa29-c66ba01b479c\") "
Nov 03 17:56:30.086594 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:30.086420    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b545b7bb-eadc-432e-aa29-c66ba01b479c-kube-api-access-kgt2v\" (UniqueName: \"kubernetes.io/projected/b545b7bb-eadc-432e-aa29-c66ba01b479c-kube-api-access-kgt2v\") pod \"b545b7bb-eadc-432e-aa29-c66ba01b479c\" (UID: \"b545b7bb-eadc-432e-aa29-c66ba01b479c\") "
Nov 03 17:56:30.086594 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:30.086459    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b545b7bb-eadc-432e-aa29-c66ba01b479c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b545b7bb-eadc-432e-aa29-c66ba01b479c-metrics-certs\") pod \"b545b7bb-eadc-432e-aa29-c66ba01b479c\" (UID: \"b545b7bb-eadc-432e-aa29-c66ba01b479c\") "
Nov 03 17:56:30.086594 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:30.086570    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b545b7bb-eadc-432e-aa29-c66ba01b479c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b545b7bb-eadc-432e-aa29-c66ba01b479c-openshift-service-ca\") pod \"b545b7bb-eadc-432e-aa29-c66ba01b479c\" (UID: \"b545b7bb-eadc-432e-aa29-c66ba01b479c\") "
Nov 03 17:56:30.086956 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:30.086927    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b545b7bb-eadc-432e-aa29-c66ba01b479c-openshift-service-ca" pod "b545b7bb-eadc-432e-aa29-c66ba01b479c" (UID: "b545b7bb-eadc-432e-aa29-c66ba01b479c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:56:30.088660 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:30.088634    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b545b7bb-eadc-432e-aa29-c66ba01b479c-maas-api-tls" pod "b545b7bb-eadc-432e-aa29-c66ba01b479c" (UID: "b545b7bb-eadc-432e-aa29-c66ba01b479c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:56:30.088761 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:30.088675    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b545b7bb-eadc-432e-aa29-c66ba01b479c-metrics-certs" pod "b545b7bb-eadc-432e-aa29-c66ba01b479c" (UID: "b545b7bb-eadc-432e-aa29-c66ba01b479c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:56:30.088761 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:30.088710    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b545b7bb-eadc-432e-aa29-c66ba01b479c-kube-api-access-kgt2v" pod "b545b7bb-eadc-432e-aa29-c66ba01b479c" (UID: "b545b7bb-eadc-432e-aa29-c66ba01b479c"). InnerVolumeSpecName "kube-api-access-kgt2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:56:30.188246 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:30.188192    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b545b7bb-eadc-432e-aa29-c66ba01b479c-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:30.188246 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:30.188252    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b545b7bb-eadc-432e-aa29-c66ba01b479c-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:30.188460 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:30.188268    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgt2v\" (UniqueName: \"kubernetes.io/projected/b545b7bb-eadc-432e-aa29-c66ba01b479c-kube-api-access-kgt2v\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:30.188460 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:30.188283    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b545b7bb-eadc-432e-aa29-c66ba01b479c-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:30.988861 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:30.988832    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"
Nov 03 17:56:31.148860 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:31.148823    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"]
Nov 03 17:56:31.196754 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:31.196720    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-af9e3c-fcbcb74fd-9h6br"]
Nov 03 17:56:32.002383 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:32.002352    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b545b7bb-eadc-432e-aa29-c66ba01b479c" path="/var/lib/kubelet/pods/b545b7bb-eadc-432e-aa29-c66ba01b479c/volumes"
Nov 03 17:56:32.848502 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:32.848464    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5" podUID="4cd6d68d-3f3e-49f4-a643-39cd05d6d72e" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:56:37.045372 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:56:37.045338    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:56:38.761896 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:38.761857    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"]
Nov 03 17:56:38.762316 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:38.762078    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd" podUID="dcd396ad-88eb-4fd2-8f21-5856f0bfb254" containerName="istio-proxy" containerID="cri-o://878534933b7db30066994525d4b32a42020677b58bb521daa16ef1139dee1353" gracePeriod=30
Nov 03 17:56:40.321101 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:40.321064    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:56:40.325367 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:40.325339    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 17:56:40.750058 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:40.749977    5021 scope.go:122] "RemoveContainer" containerID="e63be874e63a4c68b0f1a6c59199c694bb00bb3fa4a812dd803278373c736bff"
Nov 03 17:56:41.390100 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:41.390033    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"
Nov 03 17:56:41.516262 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:41.516208    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4cd6d68d-3f3e-49f4-a643-39cd05d6d72e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cd6d68d-3f3e-49f4-a643-39cd05d6d72e-plugins-config-volume\") pod \"4cd6d68d-3f3e-49f4-a643-39cd05d6d72e\" (UID: \"4cd6d68d-3f3e-49f4-a643-39cd05d6d72e\") "
Nov 03 17:56:41.516438 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:41.516335    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4cd6d68d-3f3e-49f4-a643-39cd05d6d72e-kube-api-access-jdmk7\" (UniqueName: \"kubernetes.io/projected/4cd6d68d-3f3e-49f4-a643-39cd05d6d72e-kube-api-access-jdmk7\") pod \"4cd6d68d-3f3e-49f4-a643-39cd05d6d72e\" (UID: \"4cd6d68d-3f3e-49f4-a643-39cd05d6d72e\") "
Nov 03 17:56:41.516571 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:41.516550    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cd6d68d-3f3e-49f4-a643-39cd05d6d72e-plugins-config-volume" pod "4cd6d68d-3f3e-49f4-a643-39cd05d6d72e" (UID: "4cd6d68d-3f3e-49f4-a643-39cd05d6d72e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:56:41.516732 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:41.516707    5021 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cd6d68d-3f3e-49f4-a643-39cd05d6d72e-plugins-config-volume\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:41.518899 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:41.518872    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cd6d68d-3f3e-49f4-a643-39cd05d6d72e-kube-api-access-jdmk7" pod "4cd6d68d-3f3e-49f4-a643-39cd05d6d72e" (UID: "4cd6d68d-3f3e-49f4-a643-39cd05d6d72e"). InnerVolumeSpecName "kube-api-access-jdmk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:56:41.617980 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:41.617945    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdmk7\" (UniqueName: \"kubernetes.io/projected/4cd6d68d-3f3e-49f4-a643-39cd05d6d72e-kube-api-access-jdmk7\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:42.053445 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:42.053406    5021 generic.go:356] "Generic (PLEG): container finished" podID="4cd6d68d-3f3e-49f4-a643-39cd05d6d72e" containerID="c4736202aec4abf06da00eda4f1f6a946713617b7983ae68ca057fd083fa6b70" exitCode=0
Nov 03 17:56:42.053659 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:42.053466    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"
Nov 03 17:56:42.053659 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:42.053475    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5" event={"ID":"4cd6d68d-3f3e-49f4-a643-39cd05d6d72e","Type":"ContainerDied","Data":"c4736202aec4abf06da00eda4f1f6a946713617b7983ae68ca057fd083fa6b70"}
Nov 03 17:56:42.053659 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:42.053534    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5" event={"ID":"4cd6d68d-3f3e-49f4-a643-39cd05d6d72e","Type":"ContainerDied","Data":"542e8e5d84fec02acbf20fc6878c0c33cd6cec0459b2f430cd00c27470255b28"}
Nov 03 17:56:42.053659 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:42.053561    5021 scope.go:122] "RemoveContainer" containerID="c4736202aec4abf06da00eda4f1f6a946713617b7983ae68ca057fd083fa6b70"
Nov 03 17:56:42.063098 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:42.063079    5021 scope.go:122] "RemoveContainer" containerID="c4736202aec4abf06da00eda4f1f6a946713617b7983ae68ca057fd083fa6b70"
Nov 03 17:56:42.063400 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:56:42.063379    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4736202aec4abf06da00eda4f1f6a946713617b7983ae68ca057fd083fa6b70\": container with ID starting with c4736202aec4abf06da00eda4f1f6a946713617b7983ae68ca057fd083fa6b70 not found: ID does not exist" containerID="c4736202aec4abf06da00eda4f1f6a946713617b7983ae68ca057fd083fa6b70"
Nov 03 17:56:42.063473 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:42.063410    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4736202aec4abf06da00eda4f1f6a946713617b7983ae68ca057fd083fa6b70"} err="failed to get container status \"c4736202aec4abf06da00eda4f1f6a946713617b7983ae68ca057fd083fa6b70\": rpc error: code = NotFound desc = could not find container \"c4736202aec4abf06da00eda4f1f6a946713617b7983ae68ca057fd083fa6b70\": container with ID starting with c4736202aec4abf06da00eda4f1f6a946713617b7983ae68ca057fd083fa6b70 not found: ID does not exist"
Nov 03 17:56:42.213874 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:42.213836    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"]
Nov 03 17:56:42.216501 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:42.216476    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-af9e3c-79cf5dd69f-dhfr5"]
Nov 03 17:56:44.004957 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.004924    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4cd6d68d-3f3e-49f4-a643-39cd05d6d72e" path="/var/lib/kubelet/pods/4cd6d68d-3f3e-49f4-a643-39cd05d6d72e/volumes"
Nov 03 17:56:44.022149 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.022120    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:56:44.067708 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.067634    5021 generic.go:356] "Generic (PLEG): container finished" podID="dcd396ad-88eb-4fd2-8f21-5856f0bfb254" containerID="878534933b7db30066994525d4b32a42020677b58bb521daa16ef1139dee1353" exitCode=0
Nov 03 17:56:44.067708 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.067685    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"
Nov 03 17:56:44.067708 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.067700    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd" event={"ID":"dcd396ad-88eb-4fd2-8f21-5856f0bfb254","Type":"ContainerDied","Data":"878534933b7db30066994525d4b32a42020677b58bb521daa16ef1139dee1353"}
Nov 03 17:56:44.067919 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.067751    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd" event={"ID":"dcd396ad-88eb-4fd2-8f21-5856f0bfb254","Type":"ContainerDied","Data":"13ecf18cf7cfbc9c32a962f0437fb19e99974161f8ef9562a245424971b0cb99"}
Nov 03 17:56:44.067919 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.067782    5021 scope.go:122] "RemoveContainer" containerID="878534933b7db30066994525d4b32a42020677b58bb521daa16ef1139dee1353"
Nov 03 17:56:44.080780 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.080760    5021 scope.go:122] "RemoveContainer" containerID="878534933b7db30066994525d4b32a42020677b58bb521daa16ef1139dee1353"
Nov 03 17:56:44.081084 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:56:44.081066    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"878534933b7db30066994525d4b32a42020677b58bb521daa16ef1139dee1353\": container with ID starting with 878534933b7db30066994525d4b32a42020677b58bb521daa16ef1139dee1353 not found: ID does not exist" containerID="878534933b7db30066994525d4b32a42020677b58bb521daa16ef1139dee1353"
Nov 03 17:56:44.081143 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.081094    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"878534933b7db30066994525d4b32a42020677b58bb521daa16ef1139dee1353"} err="failed to get container status \"878534933b7db30066994525d4b32a42020677b58bb521daa16ef1139dee1353\": rpc error: code = NotFound desc = could not find container \"878534933b7db30066994525d4b32a42020677b58bb521daa16ef1139dee1353\": container with ID starting with 878534933b7db30066994525d4b32a42020677b58bb521daa16ef1139dee1353 not found: ID does not exist"
Nov 03 17:56:44.148475 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.148448    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-workload-socket\") pod \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") "
Nov 03 17:56:44.148650 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.148490    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-credential-socket\") pod \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") "
Nov 03 17:56:44.148650 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.148530    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-token\" (UniqueName: \"kubernetes.io/projected/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-token\") pod \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") "
Nov 03 17:56:44.148650 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.148581    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-data\") pod \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") "
Nov 03 17:56:44.148650 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.148601    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-workload-certs\") pod \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") "
Nov 03 17:56:44.148871 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.148668    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-envoy\") pod \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") "
Nov 03 17:56:44.148871 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.148714    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istiod-ca-cert\") pod \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") "
Nov 03 17:56:44.148871 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.148736    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-workload-socket" pod "dcd396ad-88eb-4fd2-8f21-5856f0bfb254" (UID: "dcd396ad-88eb-4fd2-8f21-5856f0bfb254"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:56:44.148871 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.148771    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-kube-api-access-c9fcf\" (UniqueName: \"kubernetes.io/projected/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-kube-api-access-c9fcf\") pod \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") "
Nov 03 17:56:44.149077 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.148883    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-data" pod "dcd396ad-88eb-4fd2-8f21-5856f0bfb254" (UID: "dcd396ad-88eb-4fd2-8f21-5856f0bfb254"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:56:44.149077 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.148900    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-credential-socket" pod "dcd396ad-88eb-4fd2-8f21-5856f0bfb254" (UID: "dcd396ad-88eb-4fd2-8f21-5856f0bfb254"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:56:44.149176 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.149079    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-podinfo\") pod \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\" (UID: \"dcd396ad-88eb-4fd2-8f21-5856f0bfb254\") "
Nov 03 17:56:44.149176 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.149163    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-workload-certs" pod "dcd396ad-88eb-4fd2-8f21-5856f0bfb254" (UID: "dcd396ad-88eb-4fd2-8f21-5856f0bfb254"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:56:44.149310 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.149193    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istiod-ca-cert" pod "dcd396ad-88eb-4fd2-8f21-5856f0bfb254" (UID: "dcd396ad-88eb-4fd2-8f21-5856f0bfb254"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:56:44.149572 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.149548    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:44.149572 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.149574    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:44.149769 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.149589    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:44.149769 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.149604    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:44.149769 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.149618    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:44.151009 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.150984    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-token" pod "dcd396ad-88eb-4fd2-8f21-5856f0bfb254" (UID: "dcd396ad-88eb-4fd2-8f21-5856f0bfb254"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:56:44.151092 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.151010    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-kube-api-access-c9fcf" pod "dcd396ad-88eb-4fd2-8f21-5856f0bfb254" (UID: "dcd396ad-88eb-4fd2-8f21-5856f0bfb254"). InnerVolumeSpecName "kube-api-access-c9fcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:56:44.151092 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.151010    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-envoy" pod "dcd396ad-88eb-4fd2-8f21-5856f0bfb254" (UID: "dcd396ad-88eb-4fd2-8f21-5856f0bfb254"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:56:44.151171 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.151103    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-podinfo" pod "dcd396ad-88eb-4fd2-8f21-5856f0bfb254" (UID: "dcd396ad-88eb-4fd2-8f21-5856f0bfb254"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 17:56:44.250342 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.250306    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:44.250342 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.250344    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:44.250543 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.250382    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9fcf\" (UniqueName: \"kubernetes.io/projected/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-kube-api-access-c9fcf\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:44.250543 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.250398    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcd396ad-88eb-4fd2-8f21-5856f0bfb254-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:44.488240 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.488180    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"]
Nov 03 17:56:44.492210 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:44.492179    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-af9e3c-openshift-default-5fc5d986d5-9n6jd"]
Nov 03 17:56:45.939252 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:45.939182    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"]
Nov 03 17:56:46.002788 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:46.002752    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dcd396ad-88eb-4fd2-8f21-5856f0bfb254" path="/var/lib/kubelet/pods/dcd396ad-88eb-4fd2-8f21-5856f0bfb254/volumes"
Nov 03 17:56:50.940527 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:50.940480    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz" podUID="42ebff73-4626-4e33-bf90-035d618e3c43" containerName="payload-processing" containerID="cri-o://51435bde223c86b4ca56efe6ae86e56fa8837fa600aaeab195ce652eef1881d5" gracePeriod=25
Nov 03 17:56:54.033800 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:54.033766    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"]
Nov 03 17:56:54.034410 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:54.033946    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4" podUID="71b69226-4c13-47d5-b488-d57be1f9615c" containerName="maas-api" containerID="cri-o://655c0ab6a5eafbf0b061c99212bd2ed645e72ec8327023af0ded6b7f990fbeff" gracePeriod=30
Nov 03 17:56:54.302576 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:54.302550    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:56:54.345636 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:54.345597    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz" podUID="42ebff73-4626-4e33-bf90-035d618e3c43" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:56:54.355859 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:54.355831    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/71b69226-4c13-47d5-b488-d57be1f9615c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71b69226-4c13-47d5-b488-d57be1f9615c-maas-api-tls\") pod \"71b69226-4c13-47d5-b488-d57be1f9615c\" (UID: \"71b69226-4c13-47d5-b488-d57be1f9615c\") "
Nov 03 17:56:54.356042 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:54.355931    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/71b69226-4c13-47d5-b488-d57be1f9615c-kube-api-access-rkwhn\" (UniqueName: \"kubernetes.io/projected/71b69226-4c13-47d5-b488-d57be1f9615c-kube-api-access-rkwhn\") pod \"71b69226-4c13-47d5-b488-d57be1f9615c\" (UID: \"71b69226-4c13-47d5-b488-d57be1f9615c\") "
Nov 03 17:56:54.356042 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:54.355989    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/71b69226-4c13-47d5-b488-d57be1f9615c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/71b69226-4c13-47d5-b488-d57be1f9615c-metrics-certs\") pod \"71b69226-4c13-47d5-b488-d57be1f9615c\" (UID: \"71b69226-4c13-47d5-b488-d57be1f9615c\") "
Nov 03 17:56:54.356042 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:54.356039    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/71b69226-4c13-47d5-b488-d57be1f9615c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71b69226-4c13-47d5-b488-d57be1f9615c-openshift-service-ca\") pod \"71b69226-4c13-47d5-b488-d57be1f9615c\" (UID: \"71b69226-4c13-47d5-b488-d57be1f9615c\") "
Nov 03 17:56:54.358151 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:54.357063    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71b69226-4c13-47d5-b488-d57be1f9615c-openshift-service-ca" pod "71b69226-4c13-47d5-b488-d57be1f9615c" (UID: "71b69226-4c13-47d5-b488-d57be1f9615c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:56:54.358707 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:54.358683    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71b69226-4c13-47d5-b488-d57be1f9615c-maas-api-tls" pod "71b69226-4c13-47d5-b488-d57be1f9615c" (UID: "71b69226-4c13-47d5-b488-d57be1f9615c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:56:54.358802 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:54.358775    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71b69226-4c13-47d5-b488-d57be1f9615c-kube-api-access-rkwhn" pod "71b69226-4c13-47d5-b488-d57be1f9615c" (UID: "71b69226-4c13-47d5-b488-d57be1f9615c"). InnerVolumeSpecName "kube-api-access-rkwhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:56:54.358969 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:54.358941    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71b69226-4c13-47d5-b488-d57be1f9615c-metrics-certs" pod "71b69226-4c13-47d5-b488-d57be1f9615c" (UID: "71b69226-4c13-47d5-b488-d57be1f9615c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:56:54.458368 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:54.458329    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkwhn\" (UniqueName: \"kubernetes.io/projected/71b69226-4c13-47d5-b488-d57be1f9615c-kube-api-access-rkwhn\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:54.458368 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:54.458369    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71b69226-4c13-47d5-b488-d57be1f9615c-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:54.458572 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:54.458386    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71b69226-4c13-47d5-b488-d57be1f9615c-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:54.458572 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:54.458402    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71b69226-4c13-47d5-b488-d57be1f9615c-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:56:55.132064 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:55.132027    5021 generic.go:356] "Generic (PLEG): container finished" podID="71b69226-4c13-47d5-b488-d57be1f9615c" containerID="655c0ab6a5eafbf0b061c99212bd2ed645e72ec8327023af0ded6b7f990fbeff" exitCode=0
Nov 03 17:56:55.132538 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:55.132083    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"
Nov 03 17:56:55.132538 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:55.132117    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4" event={"ID":"71b69226-4c13-47d5-b488-d57be1f9615c","Type":"ContainerDied","Data":"655c0ab6a5eafbf0b061c99212bd2ed645e72ec8327023af0ded6b7f990fbeff"}
Nov 03 17:56:55.132538 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:55.132166    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4" event={"ID":"71b69226-4c13-47d5-b488-d57be1f9615c","Type":"ContainerDied","Data":"ec4deb5d14e19eafb60ea9bebd801653034d6b7e5b70e2f53f05226dd212f9b6"}
Nov 03 17:56:55.132538 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:55.132189    5021 scope.go:122] "RemoveContainer" containerID="655c0ab6a5eafbf0b061c99212bd2ed645e72ec8327023af0ded6b7f990fbeff"
Nov 03 17:56:55.142091 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:55.142076    5021 scope.go:122] "RemoveContainer" containerID="655c0ab6a5eafbf0b061c99212bd2ed645e72ec8327023af0ded6b7f990fbeff"
Nov 03 17:56:55.142366 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:56:55.142342    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"655c0ab6a5eafbf0b061c99212bd2ed645e72ec8327023af0ded6b7f990fbeff\": container with ID starting with 655c0ab6a5eafbf0b061c99212bd2ed645e72ec8327023af0ded6b7f990fbeff not found: ID does not exist" containerID="655c0ab6a5eafbf0b061c99212bd2ed645e72ec8327023af0ded6b7f990fbeff"
Nov 03 17:56:55.142443 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:55.142374    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"655c0ab6a5eafbf0b061c99212bd2ed645e72ec8327023af0ded6b7f990fbeff"} err="failed to get container status \"655c0ab6a5eafbf0b061c99212bd2ed645e72ec8327023af0ded6b7f990fbeff\": rpc error: code = NotFound desc = could not find container \"655c0ab6a5eafbf0b061c99212bd2ed645e72ec8327023af0ded6b7f990fbeff\": container with ID starting with 655c0ab6a5eafbf0b061c99212bd2ed645e72ec8327023af0ded6b7f990fbeff not found: ID does not exist"
Nov 03 17:56:55.291208 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:55.291173    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"]
Nov 03 17:56:55.339166 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:55.339130    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-147834-5c9cdb6b49-mx9q4"]
Nov 03 17:56:56.003597 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:56:56.003561    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="71b69226-4c13-47d5-b488-d57be1f9615c" path="/var/lib/kubelet/pods/71b69226-4c13-47d5-b488-d57be1f9615c/volumes"
Nov 03 17:57:00.058438 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:00.058404    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"]
Nov 03 17:57:00.058821 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:00.058602    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548" podUID="cf8a66ad-fe50-45f0-81ae-14cb438c3273" containerName="istio-proxy" containerID="cri-o://7e1aa6c126f7791c046427999fa2da12254a2eee5589120e2b7fde1eba962c71" gracePeriod=30
Nov 03 17:57:04.345736 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:04.345698    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz" podUID="42ebff73-4626-4e33-bf90-035d618e3c43" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 17:57:05.189982 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.189943    5021 generic.go:356] "Generic (PLEG): container finished" podID="cf8a66ad-fe50-45f0-81ae-14cb438c3273" containerID="7e1aa6c126f7791c046427999fa2da12254a2eee5589120e2b7fde1eba962c71" exitCode=0
Nov 03 17:57:05.193039 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.193006    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548" event={"ID":"cf8a66ad-fe50-45f0-81ae-14cb438c3273","Type":"ContainerDied","Data":"7e1aa6c126f7791c046427999fa2da12254a2eee5589120e2b7fde1eba962c71"}
Nov 03 17:57:05.311859 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.311834    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:57:05.374750 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.374680    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-credential-socket\") pod \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") "
Nov 03 17:57:05.374750 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.374739    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istiod-ca-cert\") pod \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") "
Nov 03 17:57:05.375217 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.374789    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-podinfo\") pod \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") "
Nov 03 17:57:05.375217 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.374814    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-workload-certs\") pod \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") "
Nov 03 17:57:05.375217 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.374853    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-workload-socket\") pod \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") "
Nov 03 17:57:05.375217 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.374890    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-token\" (UniqueName: \"kubernetes.io/projected/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-token\") pod \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") "
Nov 03 17:57:05.375217 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.374957    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-envoy\") pod \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") "
Nov 03 17:57:05.375217 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.374985    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-data\") pod \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") "
Nov 03 17:57:05.375217 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.375046    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf8a66ad-fe50-45f0-81ae-14cb438c3273-kube-api-access-qvwlh\" (UniqueName: \"kubernetes.io/projected/cf8a66ad-fe50-45f0-81ae-14cb438c3273-kube-api-access-qvwlh\") pod \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\" (UID: \"cf8a66ad-fe50-45f0-81ae-14cb438c3273\") "
Nov 03 17:57:05.375579 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.375283    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istiod-ca-cert" pod "cf8a66ad-fe50-45f0-81ae-14cb438c3273" (UID: "cf8a66ad-fe50-45f0-81ae-14cb438c3273"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:57:05.375579 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.375438    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-workload-certs" pod "cf8a66ad-fe50-45f0-81ae-14cb438c3273" (UID: "cf8a66ad-fe50-45f0-81ae-14cb438c3273"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:57:05.375579 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.375465    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-credential-socket" pod "cf8a66ad-fe50-45f0-81ae-14cb438c3273" (UID: "cf8a66ad-fe50-45f0-81ae-14cb438c3273"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:57:05.375579 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.375471    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-workload-socket" pod "cf8a66ad-fe50-45f0-81ae-14cb438c3273" (UID: "cf8a66ad-fe50-45f0-81ae-14cb438c3273"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:57:05.375794 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.375580    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:05.375794 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.375615    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:05.375794 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.375580    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-data" pod "cf8a66ad-fe50-45f0-81ae-14cb438c3273" (UID: "cf8a66ad-fe50-45f0-81ae-14cb438c3273"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:57:05.377262 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.377210    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-envoy" pod "cf8a66ad-fe50-45f0-81ae-14cb438c3273" (UID: "cf8a66ad-fe50-45f0-81ae-14cb438c3273"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:57:05.377359 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.377259    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-podinfo" pod "cf8a66ad-fe50-45f0-81ae-14cb438c3273" (UID: "cf8a66ad-fe50-45f0-81ae-14cb438c3273"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 17:57:05.377574 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.377557    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-token" pod "cf8a66ad-fe50-45f0-81ae-14cb438c3273" (UID: "cf8a66ad-fe50-45f0-81ae-14cb438c3273"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:57:05.377626 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.377584    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf8a66ad-fe50-45f0-81ae-14cb438c3273-kube-api-access-qvwlh" pod "cf8a66ad-fe50-45f0-81ae-14cb438c3273" (UID: "cf8a66ad-fe50-45f0-81ae-14cb438c3273"). InnerVolumeSpecName "kube-api-access-qvwlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:57:05.476406 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.476371    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:05.476406 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.476402    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:05.476667 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.476417    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:05.476667 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.476430    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:05.476667 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.476444    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvwlh\" (UniqueName: \"kubernetes.io/projected/cf8a66ad-fe50-45f0-81ae-14cb438c3273-kube-api-access-qvwlh\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:05.476667 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.476457    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf8a66ad-fe50-45f0-81ae-14cb438c3273-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:05.476667 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:05.476468    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf8a66ad-fe50-45f0-81ae-14cb438c3273-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:06.196474 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:06.196438    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"
Nov 03 17:57:06.196474 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:06.196455    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548" event={"ID":"cf8a66ad-fe50-45f0-81ae-14cb438c3273","Type":"ContainerDied","Data":"2818922b09034fa46f208c82be4a65490466252837bcb1d33bf6d3889a6a986c"}
Nov 03 17:57:06.196799 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:06.196518    5021 scope.go:122] "RemoveContainer" containerID="7e1aa6c126f7791c046427999fa2da12254a2eee5589120e2b7fde1eba962c71"
Nov 03 17:57:06.405501 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:06.405426    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"]
Nov 03 17:57:06.453349 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:06.453318    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-147834-openshift-default-5cf56689c9-54548"]
Nov 03 17:57:07.045132 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:57:07.045094    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:57:08.002180 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:08.002151    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf8a66ad-fe50-45f0-81ae-14cb438c3273" path="/var/lib/kubelet/pods/cf8a66ad-fe50-45f0-81ae-14cb438c3273/volumes"
Nov 03 17:57:11.193844 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:11.193818    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"
Nov 03 17:57:11.225849 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:11.225766    5021 generic.go:356] "Generic (PLEG): container finished" podID="42ebff73-4626-4e33-bf90-035d618e3c43" containerID="51435bde223c86b4ca56efe6ae86e56fa8837fa600aaeab195ce652eef1881d5" exitCode=0
Nov 03 17:57:11.225849 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:11.225809    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"
Nov 03 17:57:11.225849 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:11.225840    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz" event={"ID":"42ebff73-4626-4e33-bf90-035d618e3c43","Type":"ContainerDied","Data":"51435bde223c86b4ca56efe6ae86e56fa8837fa600aaeab195ce652eef1881d5"}
Nov 03 17:57:11.226101 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:11.225924    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz" event={"ID":"42ebff73-4626-4e33-bf90-035d618e3c43","Type":"ContainerDied","Data":"71c28c71078224ca4b26266778fe40ff0ab0d4dc34aae6ff0897b98eac774beb"}
Nov 03 17:57:11.226101 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:11.225956    5021 scope.go:122] "RemoveContainer" containerID="51435bde223c86b4ca56efe6ae86e56fa8837fa600aaeab195ce652eef1881d5"
Nov 03 17:57:11.235428 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:11.235401    5021 scope.go:122] "RemoveContainer" containerID="51435bde223c86b4ca56efe6ae86e56fa8837fa600aaeab195ce652eef1881d5"
Nov 03 17:57:11.235749 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:57:11.235678    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51435bde223c86b4ca56efe6ae86e56fa8837fa600aaeab195ce652eef1881d5\": container with ID starting with 51435bde223c86b4ca56efe6ae86e56fa8837fa600aaeab195ce652eef1881d5 not found: ID does not exist" containerID="51435bde223c86b4ca56efe6ae86e56fa8837fa600aaeab195ce652eef1881d5"
Nov 03 17:57:11.235749 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:11.235711    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51435bde223c86b4ca56efe6ae86e56fa8837fa600aaeab195ce652eef1881d5"} err="failed to get container status \"51435bde223c86b4ca56efe6ae86e56fa8837fa600aaeab195ce652eef1881d5\": rpc error: code = NotFound desc = could not find container \"51435bde223c86b4ca56efe6ae86e56fa8837fa600aaeab195ce652eef1881d5\": container with ID starting with 51435bde223c86b4ca56efe6ae86e56fa8837fa600aaeab195ce652eef1881d5 not found: ID does not exist"
Nov 03 17:57:11.335417 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:11.335385    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/42ebff73-4626-4e33-bf90-035d618e3c43-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ebff73-4626-4e33-bf90-035d618e3c43-plugins-config-volume\") pod \"42ebff73-4626-4e33-bf90-035d618e3c43\" (UID: \"42ebff73-4626-4e33-bf90-035d618e3c43\") "
Nov 03 17:57:11.335612 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:11.335426    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/42ebff73-4626-4e33-bf90-035d618e3c43-kube-api-access-m4c8s\" (UniqueName: \"kubernetes.io/projected/42ebff73-4626-4e33-bf90-035d618e3c43-kube-api-access-m4c8s\") pod \"42ebff73-4626-4e33-bf90-035d618e3c43\" (UID: \"42ebff73-4626-4e33-bf90-035d618e3c43\") "
Nov 03 17:57:11.335767 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:11.335743    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42ebff73-4626-4e33-bf90-035d618e3c43-plugins-config-volume" pod "42ebff73-4626-4e33-bf90-035d618e3c43" (UID: "42ebff73-4626-4e33-bf90-035d618e3c43"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:57:11.337822 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:11.337789    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42ebff73-4626-4e33-bf90-035d618e3c43-kube-api-access-m4c8s" pod "42ebff73-4626-4e33-bf90-035d618e3c43" (UID: "42ebff73-4626-4e33-bf90-035d618e3c43"). InnerVolumeSpecName "kube-api-access-m4c8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:57:11.436488 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:11.436455    5021 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42ebff73-4626-4e33-bf90-035d618e3c43-plugins-config-volume\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:11.436488 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:11.436486    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4c8s\" (UniqueName: \"kubernetes.io/projected/42ebff73-4626-4e33-bf90-035d618e3c43-kube-api-access-m4c8s\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:11.642899 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:11.642865    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"]
Nov 03 17:57:11.648988 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:11.648954    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w4-147834-76cd6cd59c-658rz"]
Nov 03 17:57:12.002577 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:12.002543    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="42ebff73-4626-4e33-bf90-035d618e3c43" path="/var/lib/kubelet/pods/42ebff73-4626-4e33-bf90-035d618e3c43/volumes"
Nov 03 17:57:37.050409 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:57:37.050373    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:57:51.419830 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.419752    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"]
Nov 03 17:57:51.420254 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.419949    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp" podUID="92c416fa-3174-4000-a237-55f489552b5c" containerName="discovery" containerID="cri-o://bc51615f563b69a7e33bf0c7303493a20a55a2a6624ff273bc957c39c17a6cae" gracePeriod=30
Nov 03 17:57:51.672037 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.671977    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:57:51.739437 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.739406    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92c416fa-3174-4000-a237-55f489552b5c-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/92c416fa-3174-4000-a237-55f489552b5c-istio-csr-ca-configmap\") pod \"92c416fa-3174-4000-a237-55f489552b5c\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") "
Nov 03 17:57:51.739604 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.739492    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92c416fa-3174-4000-a237-55f489552b5c-kube-api-access-8qm7g\" (UniqueName: \"kubernetes.io/projected/92c416fa-3174-4000-a237-55f489552b5c-kube-api-access-8qm7g\") pod \"92c416fa-3174-4000-a237-55f489552b5c\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") "
Nov 03 17:57:51.739604 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.739531    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-istio-kubeconfig\") pod \"92c416fa-3174-4000-a237-55f489552b5c\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") "
Nov 03 17:57:51.739604 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.739554    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-cacerts\" (UniqueName: \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-cacerts\") pod \"92c416fa-3174-4000-a237-55f489552b5c\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") "
Nov 03 17:57:51.739750 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.739615    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92c416fa-3174-4000-a237-55f489552b5c-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/92c416fa-3174-4000-a237-55f489552b5c-local-certs\") pod \"92c416fa-3174-4000-a237-55f489552b5c\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") "
Nov 03 17:57:51.739750 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.739723    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-istio-csr-dns-cert\") pod \"92c416fa-3174-4000-a237-55f489552b5c\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") "
Nov 03 17:57:51.739857 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.739764    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92c416fa-3174-4000-a237-55f489552b5c-istio-token\" (UniqueName: \"kubernetes.io/projected/92c416fa-3174-4000-a237-55f489552b5c-istio-token\") pod \"92c416fa-3174-4000-a237-55f489552b5c\" (UID: \"92c416fa-3174-4000-a237-55f489552b5c\") "
Nov 03 17:57:51.739857 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.739796    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92c416fa-3174-4000-a237-55f489552b5c-istio-csr-ca-configmap" pod "92c416fa-3174-4000-a237-55f489552b5c" (UID: "92c416fa-3174-4000-a237-55f489552b5c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 17:57:51.740132 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.740098    5021 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/92c416fa-3174-4000-a237-55f489552b5c-istio-csr-ca-configmap\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:51.741808 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.741780    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92c416fa-3174-4000-a237-55f489552b5c-kube-api-access-8qm7g" pod "92c416fa-3174-4000-a237-55f489552b5c" (UID: "92c416fa-3174-4000-a237-55f489552b5c"). InnerVolumeSpecName "kube-api-access-8qm7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:57:51.742048 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.742025    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92c416fa-3174-4000-a237-55f489552b5c-istio-token" pod "92c416fa-3174-4000-a237-55f489552b5c" (UID: "92c416fa-3174-4000-a237-55f489552b5c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 17:57:51.742204 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.742184    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-istio-kubeconfig" pod "92c416fa-3174-4000-a237-55f489552b5c" (UID: "92c416fa-3174-4000-a237-55f489552b5c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:57:51.742291 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.742221    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-cacerts" pod "92c416fa-3174-4000-a237-55f489552b5c" (UID: "92c416fa-3174-4000-a237-55f489552b5c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:57:51.742291 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.742282    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-istio-csr-dns-cert" pod "92c416fa-3174-4000-a237-55f489552b5c" (UID: "92c416fa-3174-4000-a237-55f489552b5c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 17:57:51.742362 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.742306    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92c416fa-3174-4000-a237-55f489552b5c-local-certs" pod "92c416fa-3174-4000-a237-55f489552b5c" (UID: "92c416fa-3174-4000-a237-55f489552b5c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 17:57:51.841601 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.841570    5021 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-istio-csr-dns-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:51.841601 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.841596    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92c416fa-3174-4000-a237-55f489552b5c-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:51.841601 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.841606    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qm7g\" (UniqueName: \"kubernetes.io/projected/92c416fa-3174-4000-a237-55f489552b5c-kube-api-access-8qm7g\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:51.841888 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.841616    5021 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-istio-kubeconfig\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:51.841888 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.841627    5021 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/92c416fa-3174-4000-a237-55f489552b5c-cacerts\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:51.841888 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:51.841638    5021 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/92c416fa-3174-4000-a237-55f489552b5c-local-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 17:57:52.459241 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:52.459136    5021 generic.go:356] "Generic (PLEG): container finished" podID="92c416fa-3174-4000-a237-55f489552b5c" containerID="bc51615f563b69a7e33bf0c7303493a20a55a2a6624ff273bc957c39c17a6cae" exitCode=0
Nov 03 17:57:52.459241 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:52.459199    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"
Nov 03 17:57:52.459241 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:52.459215    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp" event={"ID":"92c416fa-3174-4000-a237-55f489552b5c","Type":"ContainerDied","Data":"bc51615f563b69a7e33bf0c7303493a20a55a2a6624ff273bc957c39c17a6cae"}
Nov 03 17:57:52.459771 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:52.459313    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp" event={"ID":"92c416fa-3174-4000-a237-55f489552b5c","Type":"ContainerDied","Data":"35a570bb14e7e8b1809643a3ec28e0149105ed53a32401177199c59fb7111fa1"}
Nov 03 17:57:52.459771 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:52.459336    5021 scope.go:122] "RemoveContainer" containerID="bc51615f563b69a7e33bf0c7303493a20a55a2a6624ff273bc957c39c17a6cae"
Nov 03 17:57:52.469535 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:52.469517    5021 scope.go:122] "RemoveContainer" containerID="bc51615f563b69a7e33bf0c7303493a20a55a2a6624ff273bc957c39c17a6cae"
Nov 03 17:57:52.469827 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:57:52.469801    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc51615f563b69a7e33bf0c7303493a20a55a2a6624ff273bc957c39c17a6cae\": container with ID starting with bc51615f563b69a7e33bf0c7303493a20a55a2a6624ff273bc957c39c17a6cae not found: ID does not exist" containerID="bc51615f563b69a7e33bf0c7303493a20a55a2a6624ff273bc957c39c17a6cae"
Nov 03 17:57:52.469899 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:52.469839    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc51615f563b69a7e33bf0c7303493a20a55a2a6624ff273bc957c39c17a6cae"} err="failed to get container status \"bc51615f563b69a7e33bf0c7303493a20a55a2a6624ff273bc957c39c17a6cae\": rpc error: code = NotFound desc = could not find container \"bc51615f563b69a7e33bf0c7303493a20a55a2a6624ff273bc957c39c17a6cae\": container with ID starting with bc51615f563b69a7e33bf0c7303493a20a55a2a6624ff273bc957c39c17a6cae not found: ID does not exist"
Nov 03 17:57:52.623685 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:52.623651    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"]
Nov 03 17:57:52.627480 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:52.627458    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8qbkp"]
Nov 03 17:57:54.002561 ip-10-0-137-219 kubenswrapper[5021]: I1103 17:57:54.002526    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="92c416fa-3174-4000-a237-55f489552b5c" path="/var/lib/kubelet/pods/92c416fa-3174-4000-a237-55f489552b5c/volumes"
Nov 03 17:58:07.046130 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:58:07.046093    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:58:37.046172 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:58:37.046136    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:59:07.045783 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:59:07.045742    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 17:59:37.046454 ip-10-0-137-219 kubenswrapper[5021]: E1103 17:59:37.046414    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:00:07.045740 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:00:07.045701    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:00:12.496873 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:12.496839    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"]
Nov 03 18:00:12.497333 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:12.497037    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p" podUID="54ad6a25-5ebf-4333-85ee-2a32e01c785a" containerName="istio-proxy" containerID="cri-o://c5dccd5565b7061efe22f258a78b8f9086ecb6d451b8ac9f7c2e49e7f9c245b3" gracePeriod=30
Nov 03 18:00:17.760452 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.760423    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 18:00:17.802785 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.802705    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-data\") pod \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") "
Nov 03 18:00:17.802785 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.802758    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/54ad6a25-5ebf-4333-85ee-2a32e01c785a-kube-api-access-79dss\" (UniqueName: \"kubernetes.io/projected/54ad6a25-5ebf-4333-85ee-2a32e01c785a-kube-api-access-79dss\") pod \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") "
Nov 03 18:00:17.802785 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.802786    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istiod-ca-cert\") pod \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") "
Nov 03 18:00:17.803057 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.802819    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-podinfo\") pod \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") "
Nov 03 18:00:17.803057 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.802867    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-envoy\") pod \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") "
Nov 03 18:00:17.803057 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.802886    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-workload-certs\") pod \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") "
Nov 03 18:00:17.803057 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.802927    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-credential-socket\") pod \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") "
Nov 03 18:00:17.803057 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.802977    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-token\" (UniqueName: \"kubernetes.io/projected/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-token\") pod \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") "
Nov 03 18:00:17.803057 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.803015    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-workload-socket\") pod \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\" (UID: \"54ad6a25-5ebf-4333-85ee-2a32e01c785a\") "
Nov 03 18:00:17.803057 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.803037    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-data" pod "54ad6a25-5ebf-4333-85ee-2a32e01c785a" (UID: "54ad6a25-5ebf-4333-85ee-2a32e01c785a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:00:17.803450 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.803284    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-credential-socket" pod "54ad6a25-5ebf-4333-85ee-2a32e01c785a" (UID: "54ad6a25-5ebf-4333-85ee-2a32e01c785a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:00:17.803450 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.803304    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-workload-certs" pod "54ad6a25-5ebf-4333-85ee-2a32e01c785a" (UID: "54ad6a25-5ebf-4333-85ee-2a32e01c785a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:00:17.803559 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.803467    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-workload-socket" pod "54ad6a25-5ebf-4333-85ee-2a32e01c785a" (UID: "54ad6a25-5ebf-4333-85ee-2a32e01c785a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:00:17.803681 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.803637    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istiod-ca-cert" pod "54ad6a25-5ebf-4333-85ee-2a32e01c785a" (UID: "54ad6a25-5ebf-4333-85ee-2a32e01c785a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 18:00:17.803765 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.803680    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:00:17.803765 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.803702    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:00:17.803765 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.803716    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:00:17.805293 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.805265    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-envoy" pod "54ad6a25-5ebf-4333-85ee-2a32e01c785a" (UID: "54ad6a25-5ebf-4333-85ee-2a32e01c785a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:00:17.805408 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.805291    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-podinfo" pod "54ad6a25-5ebf-4333-85ee-2a32e01c785a" (UID: "54ad6a25-5ebf-4333-85ee-2a32e01c785a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 18:00:17.805665 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.805651    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54ad6a25-5ebf-4333-85ee-2a32e01c785a-kube-api-access-79dss" pod "54ad6a25-5ebf-4333-85ee-2a32e01c785a" (UID: "54ad6a25-5ebf-4333-85ee-2a32e01c785a"). InnerVolumeSpecName "kube-api-access-79dss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:00:17.805733 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.805662    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-token" pod "54ad6a25-5ebf-4333-85ee-2a32e01c785a" (UID: "54ad6a25-5ebf-4333-85ee-2a32e01c785a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:00:17.904411 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.904377    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:00:17.904411 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.904404    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79dss\" (UniqueName: \"kubernetes.io/projected/54ad6a25-5ebf-4333-85ee-2a32e01c785a-kube-api-access-79dss\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:00:17.904411 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.904416    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:00:17.904653 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.904424    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:00:17.904653 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.904433    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:00:17.904653 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:17.904442    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54ad6a25-5ebf-4333-85ee-2a32e01c785a-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:00:18.270639 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:18.270603    5021 generic.go:356] "Generic (PLEG): container finished" podID="54ad6a25-5ebf-4333-85ee-2a32e01c785a" containerID="c5dccd5565b7061efe22f258a78b8f9086ecb6d451b8ac9f7c2e49e7f9c245b3" exitCode=0
Nov 03 18:00:18.270815 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:18.270651    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"
Nov 03 18:00:18.270815 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:18.270691    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p" event={"ID":"54ad6a25-5ebf-4333-85ee-2a32e01c785a","Type":"ContainerDied","Data":"c5dccd5565b7061efe22f258a78b8f9086ecb6d451b8ac9f7c2e49e7f9c245b3"}
Nov 03 18:00:18.270815 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:18.270745    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p" event={"ID":"54ad6a25-5ebf-4333-85ee-2a32e01c785a","Type":"ContainerDied","Data":"3ff25e16c60440a3f7ff495297bc0dc44749d289ea79623eb5264f6d8526d1c9"}
Nov 03 18:00:18.270815 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:18.270766    5021 scope.go:122] "RemoveContainer" containerID="c5dccd5565b7061efe22f258a78b8f9086ecb6d451b8ac9f7c2e49e7f9c245b3"
Nov 03 18:00:18.280464 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:18.280444    5021 scope.go:122] "RemoveContainer" containerID="c5dccd5565b7061efe22f258a78b8f9086ecb6d451b8ac9f7c2e49e7f9c245b3"
Nov 03 18:00:18.280732 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:00:18.280712    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5dccd5565b7061efe22f258a78b8f9086ecb6d451b8ac9f7c2e49e7f9c245b3\": container with ID starting with c5dccd5565b7061efe22f258a78b8f9086ecb6d451b8ac9f7c2e49e7f9c245b3 not found: ID does not exist" containerID="c5dccd5565b7061efe22f258a78b8f9086ecb6d451b8ac9f7c2e49e7f9c245b3"
Nov 03 18:00:18.280782 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:18.280742    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5dccd5565b7061efe22f258a78b8f9086ecb6d451b8ac9f7c2e49e7f9c245b3"} err="failed to get container status \"c5dccd5565b7061efe22f258a78b8f9086ecb6d451b8ac9f7c2e49e7f9c245b3\": rpc error: code = NotFound desc = could not find container \"c5dccd5565b7061efe22f258a78b8f9086ecb6d451b8ac9f7c2e49e7f9c245b3\": container with ID starting with c5dccd5565b7061efe22f258a78b8f9086ecb6d451b8ac9f7c2e49e7f9c245b3 not found: ID does not exist"
Nov 03 18:00:18.431712 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:18.431671    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"]
Nov 03 18:00:18.480569 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:18.480535    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7ht4p"]
Nov 03 18:00:20.003007 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:00:20.002973    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="54ad6a25-5ebf-4333-85ee-2a32e01c785a" path="/var/lib/kubelet/pods/54ad6a25-5ebf-4333-85ee-2a32e01c785a/volumes"
Nov 03 18:00:37.046447 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:00:37.046407    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:01:07.045977 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:01:07.045892    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:01:37.046091 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:01:37.046049    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:01:40.363054 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:01:40.363021    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:01:40.367109 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:01:40.367083    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:02:07.045854 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:02:07.045814    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:02:37.045929 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:02:37.045846    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:03:07.045772 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:03:07.045734    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:03:37.053521 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:03:37.053458    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:04:07.045253 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:04:07.045199    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:04:21.464992 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:21.464948    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"]
Nov 03 18:04:21.465547 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:21.465236    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr" podUID="7445542c-2ec4-4a34-aae9-315652b35fe4" containerName="istio-proxy" containerID="cri-o://6139fe3a392b6b77939412483c77db16599a649bca6b648b7cca465712e2fb63" gracePeriod=30
Nov 03 18:04:26.608708 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.608675    5021 generic.go:356] "Generic (PLEG): container finished" podID="7445542c-2ec4-4a34-aae9-315652b35fe4" containerID="6139fe3a392b6b77939412483c77db16599a649bca6b648b7cca465712e2fb63" exitCode=0
Nov 03 18:04:26.609125 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.608753    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr" event={"ID":"7445542c-2ec4-4a34-aae9-315652b35fe4","Type":"ContainerDied","Data":"6139fe3a392b6b77939412483c77db16599a649bca6b648b7cca465712e2fb63"}
Nov 03 18:04:26.724534 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.724500    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 18:04:26.746290 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.746206    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-podinfo\") pod \"7445542c-2ec4-4a34-aae9-315652b35fe4\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") "
Nov 03 18:04:26.746290 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.746262    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-workload-certs\") pod \"7445542c-2ec4-4a34-aae9-315652b35fe4\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") "
Nov 03 18:04:26.746455 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.746299    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-token\" (UniqueName: \"kubernetes.io/projected/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-token\") pod \"7445542c-2ec4-4a34-aae9-315652b35fe4\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") "
Nov 03 18:04:26.746455 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.746352    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7445542c-2ec4-4a34-aae9-315652b35fe4-kube-api-access-44j7z\" (UniqueName: \"kubernetes.io/projected/7445542c-2ec4-4a34-aae9-315652b35fe4-kube-api-access-44j7z\") pod \"7445542c-2ec4-4a34-aae9-315652b35fe4\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") "
Nov 03 18:04:26.746536 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.746380    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-credential-socket\") pod \"7445542c-2ec4-4a34-aae9-315652b35fe4\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") "
Nov 03 18:04:26.746536 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.746515    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-workload-socket\") pod \"7445542c-2ec4-4a34-aae9-315652b35fe4\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") "
Nov 03 18:04:26.746642 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.746558    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7445542c-2ec4-4a34-aae9-315652b35fe4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7445542c-2ec4-4a34-aae9-315652b35fe4-istiod-ca-cert\") pod \"7445542c-2ec4-4a34-aae9-315652b35fe4\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") "
Nov 03 18:04:26.746642 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.746599    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-envoy\") pod \"7445542c-2ec4-4a34-aae9-315652b35fe4\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") "
Nov 03 18:04:26.746642 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.746635    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-credential-socket" pod "7445542c-2ec4-4a34-aae9-315652b35fe4" (UID: "7445542c-2ec4-4a34-aae9-315652b35fe4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:04:26.746801 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.746647    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-data\") pod \"7445542c-2ec4-4a34-aae9-315652b35fe4\" (UID: \"7445542c-2ec4-4a34-aae9-315652b35fe4\") "
Nov 03 18:04:26.746801 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.746650    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-workload-certs" pod "7445542c-2ec4-4a34-aae9-315652b35fe4" (UID: "7445542c-2ec4-4a34-aae9-315652b35fe4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:04:26.746904 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.746795    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-workload-socket" pod "7445542c-2ec4-4a34-aae9-315652b35fe4" (UID: "7445542c-2ec4-4a34-aae9-315652b35fe4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:04:26.746904 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.746867    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-data" pod "7445542c-2ec4-4a34-aae9-315652b35fe4" (UID: "7445542c-2ec4-4a34-aae9-315652b35fe4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:04:26.747048 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.747016    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7445542c-2ec4-4a34-aae9-315652b35fe4-istiod-ca-cert" pod "7445542c-2ec4-4a34-aae9-315652b35fe4" (UID: "7445542c-2ec4-4a34-aae9-315652b35fe4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 18:04:26.747173 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.747087    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:04:26.747173 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.747104    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:04:26.747173 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.747113    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:04:26.747173 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.747122    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:04:26.748692 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.748666    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-envoy" pod "7445542c-2ec4-4a34-aae9-315652b35fe4" (UID: "7445542c-2ec4-4a34-aae9-315652b35fe4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:04:26.748770 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.748689    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7445542c-2ec4-4a34-aae9-315652b35fe4-kube-api-access-44j7z" pod "7445542c-2ec4-4a34-aae9-315652b35fe4" (UID: "7445542c-2ec4-4a34-aae9-315652b35fe4"). InnerVolumeSpecName "kube-api-access-44j7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:04:26.748880 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.748860    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-token" pod "7445542c-2ec4-4a34-aae9-315652b35fe4" (UID: "7445542c-2ec4-4a34-aae9-315652b35fe4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:04:26.748971 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.748875    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-podinfo" pod "7445542c-2ec4-4a34-aae9-315652b35fe4" (UID: "7445542c-2ec4-4a34-aae9-315652b35fe4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 18:04:26.848454 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.848415    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:04:26.848454 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.848447    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:04:26.848669 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.848470    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44j7z\" (UniqueName: \"kubernetes.io/projected/7445542c-2ec4-4a34-aae9-315652b35fe4-kube-api-access-44j7z\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:04:26.848669 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.848482    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7445542c-2ec4-4a34-aae9-315652b35fe4-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:04:26.848669 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:26.848494    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7445542c-2ec4-4a34-aae9-315652b35fe4-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:04:27.615238 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:27.615194    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"
Nov 03 18:04:27.615238 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:27.615234    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr" event={"ID":"7445542c-2ec4-4a34-aae9-315652b35fe4","Type":"ContainerDied","Data":"036e53c2b512a8592b8ce39cbeca78c4b317fa0a8d74d2fac7e0dc2357b09492"}
Nov 03 18:04:27.615803 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:27.615292    5021 scope.go:122] "RemoveContainer" containerID="6139fe3a392b6b77939412483c77db16599a649bca6b648b7cca465712e2fb63"
Nov 03 18:04:27.844672 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:27.844636    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"]
Nov 03 18:04:27.897916 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:27.897839    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-b-8c9b0f-openshift-default-5cf4b7d76f-8z4xr"]
Nov 03 18:04:28.002588 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:04:28.002556    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7445542c-2ec4-4a34-aae9-315652b35fe4" path="/var/lib/kubelet/pods/7445542c-2ec4-4a34-aae9-315652b35fe4/volumes"
Nov 03 18:04:37.045452 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:04:37.045411    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:05:07.046406 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:05:07.046369    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:05:37.046253 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:05:37.046153    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:06:07.045989 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:06:07.045947    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:06:37.045896 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:06:37.045855    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:06:40.401749 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:06:40.401715    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:06:40.406267 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:06:40.406244    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:07:07.045815 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:07:07.045735    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:07:37.049465 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:07:37.049422    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:08:07.045404 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:08:07.045368    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:08:37.045108 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:08:37.045018    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:09:07.046165 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:09:07.046127    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:09:37.044869 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:09:37.044832    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:10:07.048982 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:10:07.048894    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:10:37.045378 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:10:37.045342    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:11:07.045478 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:11:07.045433    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:11:37.045466 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:11:37.045429    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:11:40.438017 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:11:40.437908    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:11:40.442742 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:11:40.442719    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:12:07.045653 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:12:07.045611    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:12:37.044804 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:12:37.044758    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:13:07.045185 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:13:07.045109    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:13:37.045605 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:13:37.045563    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:14:07.046268 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:14:07.046214    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:14:37.045578 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:14:37.045540    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:15:00.379075 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379036    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"]
Nov 03 18:15:00.379591 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379493    5021 cpu_manager.go:414] "containerMap: removing container" podUID="b4b88c90-269d-4cc4-a6aa-c63771b9a235" containerName="istio-proxy"
Nov 03 18:15:00.379591 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379505    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b4b88c90-269d-4cc4-a6aa-c63771b9a235" containerName="istio-proxy"
Nov 03 18:15:00.379591 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379516    5021 cpu_manager.go:414] "containerMap: removing container" podUID="92c416fa-3174-4000-a237-55f489552b5c" containerName="discovery"
Nov 03 18:15:00.379591 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379522    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92c416fa-3174-4000-a237-55f489552b5c" containerName="discovery"
Nov 03 18:15:00.379591 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379532    5021 cpu_manager.go:414] "containerMap: removing container" podUID="71b69226-4c13-47d5-b488-d57be1f9615c" containerName="maas-api"
Nov 03 18:15:00.379591 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379538    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="71b69226-4c13-47d5-b488-d57be1f9615c" containerName="maas-api"
Nov 03 18:15:00.379591 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379550    5021 cpu_manager.go:414] "containerMap: removing container" podUID="b545b7bb-eadc-432e-aa29-c66ba01b479c" containerName="maas-api"
Nov 03 18:15:00.379591 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379554    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b545b7bb-eadc-432e-aa29-c66ba01b479c" containerName="maas-api"
Nov 03 18:15:00.379591 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379568    5021 cpu_manager.go:414] "containerMap: removing container" podUID="dcd396ad-88eb-4fd2-8f21-5856f0bfb254" containerName="istio-proxy"
Nov 03 18:15:00.379591 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379573    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dcd396ad-88eb-4fd2-8f21-5856f0bfb254" containerName="istio-proxy"
Nov 03 18:15:00.379591 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379581    5021 cpu_manager.go:414] "containerMap: removing container" podUID="af74c940-4933-4b51-8d80-6245266f7eb2" containerName="payload-processing"
Nov 03 18:15:00.379591 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379585    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="af74c940-4933-4b51-8d80-6245266f7eb2" containerName="payload-processing"
Nov 03 18:15:00.379591 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379592    5021 cpu_manager.go:414] "containerMap: removing container" podUID="3e2536be-1a61-4e35-9ed6-a7934225176e" containerName="istio-proxy"
Nov 03 18:15:00.379591 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379597    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e2536be-1a61-4e35-9ed6-a7934225176e" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379605    5021 cpu_manager.go:414] "containerMap: removing container" podUID="cfe27d86-502c-4112-a7d8-8877cbc7cedc" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379610    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cfe27d86-502c-4112-a7d8-8877cbc7cedc" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379617    5021 cpu_manager.go:414] "containerMap: removing container" podUID="9fee614b-4abf-47b2-9426-4938635fdf21" containerName="payload-pre-processing"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379621    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9fee614b-4abf-47b2-9426-4938635fdf21" containerName="payload-pre-processing"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379628    5021 cpu_manager.go:414] "containerMap: removing container" podUID="42ebff73-4626-4e33-bf90-035d618e3c43" containerName="payload-processing"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379632    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42ebff73-4626-4e33-bf90-035d618e3c43" containerName="payload-processing"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379639    5021 cpu_manager.go:414] "containerMap: removing container" podUID="cf8a66ad-fe50-45f0-81ae-14cb438c3273" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379643    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf8a66ad-fe50-45f0-81ae-14cb438c3273" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379654    5021 cpu_manager.go:414] "containerMap: removing container" podUID="cff818c4-007c-46a3-a372-fd2c790e849b" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379659    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cff818c4-007c-46a3-a372-fd2c790e849b" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379667    5021 cpu_manager.go:414] "containerMap: removing container" podUID="3ff82716-8419-4b5e-8551-7bcd37365a31" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379671    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ff82716-8419-4b5e-8551-7bcd37365a31" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379678    5021 cpu_manager.go:414] "containerMap: removing container" podUID="0ff9164a-f56b-4cbc-a49b-9a7fb21723fd" containerName="maas-api"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379684    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ff9164a-f56b-4cbc-a49b-9a7fb21723fd" containerName="maas-api"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379690    5021 cpu_manager.go:414] "containerMap: removing container" podUID="0ec638e1-c16b-4853-9079-7de44f5d4070" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379695    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ec638e1-c16b-4853-9079-7de44f5d4070" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379702    5021 cpu_manager.go:414] "containerMap: removing container" podUID="f8f2cfcf-bea5-4a8f-b78e-70779445cee7" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379707    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f8f2cfcf-bea5-4a8f-b78e-70779445cee7" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379713    5021 cpu_manager.go:414] "containerMap: removing container" podUID="7445542c-2ec4-4a34-aae9-315652b35fe4" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379717    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7445542c-2ec4-4a34-aae9-315652b35fe4" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379727    5021 cpu_manager.go:414] "containerMap: removing container" podUID="4cd6d68d-3f3e-49f4-a643-39cd05d6d72e" containerName="payload-pre-processing"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379732    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4cd6d68d-3f3e-49f4-a643-39cd05d6d72e" containerName="payload-pre-processing"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379742    5021 cpu_manager.go:414] "containerMap: removing container" podUID="54ad6a25-5ebf-4333-85ee-2a32e01c785a" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379747    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="54ad6a25-5ebf-4333-85ee-2a32e01c785a" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379828    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="af74c940-4933-4b51-8d80-6245266f7eb2" containerName="payload-processing"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379835    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="dcd396ad-88eb-4fd2-8f21-5856f0bfb254" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379843    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="9fee614b-4abf-47b2-9426-4938635fdf21" containerName="payload-pre-processing"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379849    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="42ebff73-4626-4e33-bf90-035d618e3c43" containerName="payload-processing"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379855    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="92c416fa-3174-4000-a237-55f489552b5c" containerName="discovery"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379860    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf8a66ad-fe50-45f0-81ae-14cb438c3273" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379866    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="b4b88c90-269d-4cc4-a6aa-c63771b9a235" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379872    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="71b69226-4c13-47d5-b488-d57be1f9615c" containerName="maas-api"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379877    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="b545b7bb-eadc-432e-aa29-c66ba01b479c" containerName="maas-api"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379883    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="3ff82716-8419-4b5e-8551-7bcd37365a31" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379888    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e2536be-1a61-4e35-9ed6-a7934225176e" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379893    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="cfe27d86-502c-4112-a7d8-8877cbc7cedc" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379898    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="cff818c4-007c-46a3-a372-fd2c790e849b" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379904    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ff9164a-f56b-4cbc-a49b-9a7fb21723fd" containerName="maas-api"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379909    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ec638e1-c16b-4853-9079-7de44f5d4070" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379914    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="7445542c-2ec4-4a34-aae9-315652b35fe4" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379920    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="f8f2cfcf-bea5-4a8f-b78e-70779445cee7" containerName="istio-proxy"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379925    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="4cd6d68d-3f3e-49f4-a643-39cd05d6d72e" containerName="payload-pre-processing"
Nov 03 18:15:00.380008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.379931    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="54ad6a25-5ebf-4333-85ee-2a32e01c785a" containerName="istio-proxy"
Nov 03 18:15:00.383149 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.383129    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.420815 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.420779    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.420962 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.420814    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.420962 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.420837    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.420962 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.420854    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.421068 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.421003    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klldq\" (UniqueName: \"kubernetes.io/projected/afe82602-f930-4bde-8f2f-7bc4ddc70347-kube-api-access-klldq\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.421068 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.421049    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.421172 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.421136    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afe82602-f930-4bde-8f2f-7bc4ddc70347-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.421269 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.421253    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.421323 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.421297    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.445821 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.445791    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"]
Nov 03 18:15:00.521956 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.521922    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.521956 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.521962    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.522171 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.521978    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.522171 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.521995    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.522171 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.522014    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.522171 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.522041    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klldq\" (UniqueName: \"kubernetes.io/projected/afe82602-f930-4bde-8f2f-7bc4ddc70347-kube-api-access-klldq\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.522171 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.522070    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.522171 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.522104    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afe82602-f930-4bde-8f2f-7bc4ddc70347-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.522522 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.522175    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.522522 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.522502    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.522650 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.522537    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.522650 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.522630    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.522765 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.522649    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.522922 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.522899    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afe82602-f930-4bde-8f2f-7bc4ddc70347-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.524599 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.524576    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.524701 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.524676    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.602022 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.601995    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.606145 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.606115    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klldq\" (UniqueName: \"kubernetes.io/projected/afe82602-f930-4bde-8f2f-7bc4ddc70347-kube-api-access-klldq\") pod \"maas-default-gateway-openshift-default-58c6585447-xrz82\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:00.695681 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:00.695599    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:01.138246 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:01.136884    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"]
Nov 03 18:15:01.142559 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:01.142530    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 18:15:01.142649 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:01.142589    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 18:15:01.142649 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:01.142617    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 18:15:02.011019 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:02.010982    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82" event={"ID":"afe82602-f930-4bde-8f2f-7bc4ddc70347","Type":"ContainerStarted","Data":"a9f05e7dbf3eca9a8a91cdefd3a03a8faf858ffe3019d7668171a393b642aa0a"}
Nov 03 18:15:02.011525 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:02.011037    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82" event={"ID":"afe82602-f930-4bde-8f2f-7bc4ddc70347","Type":"ContainerStarted","Data":"5550d3ffc8306db14d00faa893386daa567a780b61dbe1f42db503f3e1afa22a"}
Nov 03 18:15:02.252643 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:02.252589    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82" podStartSLOduration=2.252567774 podStartE2EDuration="2.252567774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 18:15:02.191028269 +0000 UTC m=+3502.392366322" watchObservedRunningTime="2026-11-03 18:15:02.252567774 +0000 UTC m=+3502.453905827"
Nov 03 18:15:02.696274 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:02.696221    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:02.697760 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:02.697725    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xrz82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Nov 03 18:15:02.697877 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:02.697780    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82" podUID="afe82602-f930-4bde-8f2f-7bc4ddc70347" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Nov 03 18:15:03.696966 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:03.696931    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xrz82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Nov 03 18:15:03.697401 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:03.697000    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82" podUID="afe82602-f930-4bde-8f2f-7bc4ddc70347" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Nov 03 18:15:04.696903 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:04.696869    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xrz82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Nov 03 18:15:04.697090 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:04.696923    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82" podUID="afe82602-f930-4bde-8f2f-7bc4ddc70347" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Nov 03 18:15:05.705683 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:05.705642    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xrz82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Nov 03 18:15:05.706433 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:05.706399    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82" podUID="afe82602-f930-4bde-8f2f-7bc4ddc70347" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Nov 03 18:15:06.696431 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:06.696389    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xrz82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Nov 03 18:15:06.696614 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:06.696455    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82" podUID="afe82602-f930-4bde-8f2f-7bc4ddc70347" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Nov 03 18:15:07.077864 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:15:07.077824    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:15:07.696607 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:07.696572    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xrz82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Nov 03 18:15:07.696785 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:07.696630    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82" podUID="afe82602-f930-4bde-8f2f-7bc4ddc70347" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Nov 03 18:15:08.696672 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:08.696641    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xrz82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Nov 03 18:15:08.697057 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:08.696692    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82" podUID="afe82602-f930-4bde-8f2f-7bc4ddc70347" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Nov 03 18:15:10.477907 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:10.477874    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:10.478428 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:10.478254    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:10.479139 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:10.479117    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:15:15.340037 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.340002    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"]
Nov 03 18:15:15.343774 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.343756    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.454915 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.454881    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"]
Nov 03 18:15:15.479404 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.479363    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57458b9b-d189-4308-9023-d94e3900b98c-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.479563 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.479419    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vsvq\" (UniqueName: \"kubernetes.io/projected/57458b9b-d189-4308-9023-d94e3900b98c-kube-api-access-2vsvq\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.479563 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.479512    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.479653 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.479569    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57458b9b-d189-4308-9023-d94e3900b98c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.479700 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.479645    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.479700 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.479671    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.479700 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.479698    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57458b9b-d189-4308-9023-d94e3900b98c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.479811 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.479726    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.479873 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.479852    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.581002 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.580952    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.581002 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.581004    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57458b9b-d189-4308-9023-d94e3900b98c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.581295 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.581030    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.581295 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.581072    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.581295 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.581097    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57458b9b-d189-4308-9023-d94e3900b98c-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.581295 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.581132    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vsvq\" (UniqueName: \"kubernetes.io/projected/57458b9b-d189-4308-9023-d94e3900b98c-kube-api-access-2vsvq\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.581295 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.581173    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.581563 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.581387    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57458b9b-d189-4308-9023-d94e3900b98c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.581563 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.581435    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.581563 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.581436    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.581714 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.581631    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.581770 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.581706    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.581852 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.581826    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.581909 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.581895    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57458b9b-d189-4308-9023-d94e3900b98c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.583442 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.583417    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.583903 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.583882    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57458b9b-d189-4308-9023-d94e3900b98c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.645868 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.645799    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57458b9b-d189-4308-9023-d94e3900b98c-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.645993 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.645932    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vsvq\" (UniqueName: \"kubernetes.io/projected/57458b9b-d189-4308-9023-d94e3900b98c-kube-api-access-2vsvq\") pod \"maas-default-gateway-openshift-default-58c6585447-4nxzt\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:15.657792 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:15.657768    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:16.091926 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:16.091890    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"]
Nov 03 18:15:16.092366 ip-10-0-137-219 kubenswrapper[5021]: W1103 18:15:16.092343    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57458b9b_d189_4308_9023_d94e3900b98c.slice/crio-0431ddc35d02ee93f142495b5c05139a521adb99593ddbec71fe1c9995811244 WatchSource:0}: Error finding container 0431ddc35d02ee93f142495b5c05139a521adb99593ddbec71fe1c9995811244: Status 404 returned error can't find the container with id 0431ddc35d02ee93f142495b5c05139a521adb99593ddbec71fe1c9995811244
Nov 03 18:15:16.095171 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:16.095143    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 18:15:16.095295 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:16.095204    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 18:15:16.095295 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:16.095271    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 18:15:16.118297 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:16.118267    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt" event={"ID":"57458b9b-d189-4308-9023-d94e3900b98c","Type":"ContainerStarted","Data":"0431ddc35d02ee93f142495b5c05139a521adb99593ddbec71fe1c9995811244"}
Nov 03 18:15:17.149507 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:17.149460    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt" event={"ID":"57458b9b-d189-4308-9023-d94e3900b98c","Type":"ContainerStarted","Data":"9def303dce7519d6e42a3902346f1482b844c02352cf2bd60a6217ac45f35369"}
Nov 03 18:15:17.361174 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:17.361117    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt" podStartSLOduration=2.361096015 podStartE2EDuration="2.361096015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 18:15:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 18:15:17.324297967 +0000 UTC m=+3517.525636020" watchObservedRunningTime="2026-11-03 18:15:17.361096015 +0000 UTC m=+3517.562434066"
Nov 03 18:15:17.658871 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:17.658833    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:17.660904 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:17.660876    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-4nxzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Nov 03 18:15:17.661018 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:17.660928    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt" podUID="57458b9b-d189-4308-9023-d94e3900b98c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Nov 03 18:15:18.658519 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:18.658474    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-4nxzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Nov 03 18:15:18.658997 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:18.658538    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt" podUID="57458b9b-d189-4308-9023-d94e3900b98c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Nov 03 18:15:19.658536 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:19.658497    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-4nxzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Nov 03 18:15:19.658930 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:19.658552    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt" podUID="57458b9b-d189-4308-9023-d94e3900b98c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Nov 03 18:15:20.658630 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:20.658591    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-4nxzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Nov 03 18:15:20.659025 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:20.658648    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt" podUID="57458b9b-d189-4308-9023-d94e3900b98c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Nov 03 18:15:21.658798 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:21.658755    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-4nxzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Nov 03 18:15:21.659306 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:21.658815    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt" podUID="57458b9b-d189-4308-9023-d94e3900b98c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Nov 03 18:15:22.658365 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:22.658329    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-4nxzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Nov 03 18:15:22.658567 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:22.658392    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt" podUID="57458b9b-d189-4308-9023-d94e3900b98c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Nov 03 18:15:23.658789 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:23.658754    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-4nxzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Nov 03 18:15:23.659185 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:23.658809    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt" podUID="57458b9b-d189-4308-9023-d94e3900b98c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Nov 03 18:15:25.413674 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:25.413635    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:25.414176 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:25.413957    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:25.414985 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:15:25.414965    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:15:37.045789 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:15:37.045744    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:16:07.046457 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:16:07.046423    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:16:37.045602 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:16:37.045561    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:16:40.475487 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:16:40.475374    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:16:40.485509 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:16:40.485488    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:17:07.047878 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:17:07.047824    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:17:37.046660 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:17:37.046620    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:18:07.045601 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:18:07.045566    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:18:37.045798 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:18:37.045761    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:19:07.045999 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:19:07.045919    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:19:37.046147 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:19:37.046108    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:20:07.046352 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:20:07.046314    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:20:37.046203 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:20:37.046129    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:20:46.703642 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:46.703603    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"]
Nov 03 18:20:46.704154 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:46.703819    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt" podUID="57458b9b-d189-4308-9023-d94e3900b98c" containerName="istio-proxy" containerID="cri-o://9def303dce7519d6e42a3902346f1482b844c02352cf2bd60a6217ac45f35369" gracePeriod=30
Nov 03 18:20:51.965269 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:51.965221    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:20:51.990174 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:51.990098    5021 generic.go:356] "Generic (PLEG): container finished" podID="57458b9b-d189-4308-9023-d94e3900b98c" containerID="9def303dce7519d6e42a3902346f1482b844c02352cf2bd60a6217ac45f35369" exitCode=0
Nov 03 18:20:51.990174 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:51.990149    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"
Nov 03 18:20:51.990350 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:51.990180    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt" event={"ID":"57458b9b-d189-4308-9023-d94e3900b98c","Type":"ContainerDied","Data":"9def303dce7519d6e42a3902346f1482b844c02352cf2bd60a6217ac45f35369"}
Nov 03 18:20:51.990350 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:51.990248    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt" event={"ID":"57458b9b-d189-4308-9023-d94e3900b98c","Type":"ContainerDied","Data":"0431ddc35d02ee93f142495b5c05139a521adb99593ddbec71fe1c9995811244"}
Nov 03 18:20:51.990350 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:51.990284    5021 scope.go:122] "RemoveContainer" containerID="9def303dce7519d6e42a3902346f1482b844c02352cf2bd60a6217ac45f35369"
Nov 03 18:20:52.001912 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.001894    5021 scope.go:122] "RemoveContainer" containerID="9def303dce7519d6e42a3902346f1482b844c02352cf2bd60a6217ac45f35369"
Nov 03 18:20:52.002606 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:20:52.002580    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9def303dce7519d6e42a3902346f1482b844c02352cf2bd60a6217ac45f35369\": container with ID starting with 9def303dce7519d6e42a3902346f1482b844c02352cf2bd60a6217ac45f35369 not found: ID does not exist" containerID="9def303dce7519d6e42a3902346f1482b844c02352cf2bd60a6217ac45f35369"
Nov 03 18:20:52.002797 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.002618    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9def303dce7519d6e42a3902346f1482b844c02352cf2bd60a6217ac45f35369"} err="failed to get container status \"9def303dce7519d6e42a3902346f1482b844c02352cf2bd60a6217ac45f35369\": rpc error: code = NotFound desc = could not find container \"9def303dce7519d6e42a3902346f1482b844c02352cf2bd60a6217ac45f35369\": container with ID starting with 9def303dce7519d6e42a3902346f1482b844c02352cf2bd60a6217ac45f35369 not found: ID does not exist"
Nov 03 18:20:52.085766 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.085735    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-workload-socket\") pod \"57458b9b-d189-4308-9023-d94e3900b98c\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") "
Nov 03 18:20:52.085937 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.085793    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-istio-data\") pod \"57458b9b-d189-4308-9023-d94e3900b98c\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") "
Nov 03 18:20:52.085937 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.085856    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-credential-socket\") pod \"57458b9b-d189-4308-9023-d94e3900b98c\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") "
Nov 03 18:20:52.085937 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.085887    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/57458b9b-d189-4308-9023-d94e3900b98c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57458b9b-d189-4308-9023-d94e3900b98c-istiod-ca-cert\") pod \"57458b9b-d189-4308-9023-d94e3900b98c\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") "
Nov 03 18:20:52.086118 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.085941    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-workload-certs\") pod \"57458b9b-d189-4308-9023-d94e3900b98c\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") "
Nov 03 18:20:52.086118 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.086015    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57458b9b-d189-4308-9023-d94e3900b98c-istio-token\" (UniqueName: \"kubernetes.io/projected/57458b9b-d189-4308-9023-d94e3900b98c-istio-token\") pod \"57458b9b-d189-4308-9023-d94e3900b98c\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") "
Nov 03 18:20:52.086118 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.086038    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/57458b9b-d189-4308-9023-d94e3900b98c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57458b9b-d189-4308-9023-d94e3900b98c-istio-podinfo\") pod \"57458b9b-d189-4308-9023-d94e3900b98c\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") "
Nov 03 18:20:52.086118 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.086079    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-credential-socket" pod "57458b9b-d189-4308-9023-d94e3900b98c" (UID: "57458b9b-d189-4308-9023-d94e3900b98c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:20:52.086118 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.086089    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57458b9b-d189-4308-9023-d94e3900b98c-kube-api-access-2vsvq\" (UniqueName: \"kubernetes.io/projected/57458b9b-d189-4308-9023-d94e3900b98c-kube-api-access-2vsvq\") pod \"57458b9b-d189-4308-9023-d94e3900b98c\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") "
Nov 03 18:20:52.086118 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.086107    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-istio-data" pod "57458b9b-d189-4308-9023-d94e3900b98c" (UID: "57458b9b-d189-4308-9023-d94e3900b98c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:20:52.086459 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.086136    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-istio-envoy\") pod \"57458b9b-d189-4308-9023-d94e3900b98c\" (UID: \"57458b9b-d189-4308-9023-d94e3900b98c\") "
Nov 03 18:20:52.086459 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.086386    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57458b9b-d189-4308-9023-d94e3900b98c-istiod-ca-cert" pod "57458b9b-d189-4308-9023-d94e3900b98c" (UID: "57458b9b-d189-4308-9023-d94e3900b98c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 18:20:52.086459 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.086388    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-workload-certs" pod "57458b9b-d189-4308-9023-d94e3900b98c" (UID: "57458b9b-d189-4308-9023-d94e3900b98c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:20:52.086627 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.086606    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:20:52.086684 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.086627    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:20:52.086684 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.086641    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57458b9b-d189-4308-9023-d94e3900b98c-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:20:52.086684 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.086653    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:20:52.086811 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.086696    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-workload-socket" pod "57458b9b-d189-4308-9023-d94e3900b98c" (UID: "57458b9b-d189-4308-9023-d94e3900b98c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:20:52.088367 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.088336    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57458b9b-d189-4308-9023-d94e3900b98c-istio-token" pod "57458b9b-d189-4308-9023-d94e3900b98c" (UID: "57458b9b-d189-4308-9023-d94e3900b98c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:20:52.088490 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.088427    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-istio-envoy" pod "57458b9b-d189-4308-9023-d94e3900b98c" (UID: "57458b9b-d189-4308-9023-d94e3900b98c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:20:52.088769 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.088746    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57458b9b-d189-4308-9023-d94e3900b98c-kube-api-access-2vsvq" pod "57458b9b-d189-4308-9023-d94e3900b98c" (UID: "57458b9b-d189-4308-9023-d94e3900b98c"). InnerVolumeSpecName "kube-api-access-2vsvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:20:52.088866 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.088763    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/57458b9b-d189-4308-9023-d94e3900b98c-istio-podinfo" pod "57458b9b-d189-4308-9023-d94e3900b98c" (UID: "57458b9b-d189-4308-9023-d94e3900b98c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 18:20:52.187594 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.187559    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57458b9b-d189-4308-9023-d94e3900b98c-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:20:52.187594 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.187590    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57458b9b-d189-4308-9023-d94e3900b98c-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:20:52.187594 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.187601    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vsvq\" (UniqueName: \"kubernetes.io/projected/57458b9b-d189-4308-9023-d94e3900b98c-kube-api-access-2vsvq\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:20:52.187824 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.187612    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:20:52.187824 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.187621    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57458b9b-d189-4308-9023-d94e3900b98c-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:20:52.430990 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.430955    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"]
Nov 03 18:20:52.442673 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:52.442641    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4nxzt"]
Nov 03 18:20:54.003013 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:20:54.002979    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="57458b9b-d189-4308-9023-d94e3900b98c" path="/var/lib/kubelet/pods/57458b9b-d189-4308-9023-d94e3900b98c/volumes"
Nov 03 18:21:07.046100 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:21:07.046066    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:21:37.046022 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:21:37.045985    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:21:40.520088 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:40.520061    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:21:40.532288 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:40.532262    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:21:47.165332 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:47.165294    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"]
Nov 03 18:21:47.165820 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:47.165582    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82" podUID="afe82602-f930-4bde-8f2f-7bc4ddc70347" containerName="istio-proxy" containerID="cri-o://a9f05e7dbf3eca9a8a91cdefd3a03a8faf858ffe3019d7668171a393b642aa0a" gracePeriod=30
Nov 03 18:21:52.312797 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.312582    5021 generic.go:356] "Generic (PLEG): container finished" podID="afe82602-f930-4bde-8f2f-7bc4ddc70347" containerID="a9f05e7dbf3eca9a8a91cdefd3a03a8faf858ffe3019d7668171a393b642aa0a" exitCode=0
Nov 03 18:21:52.312797 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.312705    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82" event={"ID":"afe82602-f930-4bde-8f2f-7bc4ddc70347","Type":"ContainerDied","Data":"a9f05e7dbf3eca9a8a91cdefd3a03a8faf858ffe3019d7668171a393b642aa0a"}
Nov 03 18:21:52.423300 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.423273    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:21:52.503889 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.503856    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/afe82602-f930-4bde-8f2f-7bc4ddc70347-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afe82602-f930-4bde-8f2f-7bc4ddc70347-istiod-ca-cert\") pod \"afe82602-f930-4bde-8f2f-7bc4ddc70347\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") "
Nov 03 18:21:52.504095 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.503900    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-workload-socket\") pod \"afe82602-f930-4bde-8f2f-7bc4ddc70347\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") "
Nov 03 18:21:52.504095 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.503921    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-envoy\") pod \"afe82602-f930-4bde-8f2f-7bc4ddc70347\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") "
Nov 03 18:21:52.504095 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.503952    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-data\") pod \"afe82602-f930-4bde-8f2f-7bc4ddc70347\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") "
Nov 03 18:21:52.504095 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.503991    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-workload-certs\") pod \"afe82602-f930-4bde-8f2f-7bc4ddc70347\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") "
Nov 03 18:21:52.504095 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.504075    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-credential-socket\") pod \"afe82602-f930-4bde-8f2f-7bc4ddc70347\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") "
Nov 03 18:21:52.504529 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.504125    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-podinfo\") pod \"afe82602-f930-4bde-8f2f-7bc4ddc70347\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") "
Nov 03 18:21:52.504529 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.504152    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-token\" (UniqueName: \"kubernetes.io/projected/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-token\") pod \"afe82602-f930-4bde-8f2f-7bc4ddc70347\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") "
Nov 03 18:21:52.504529 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.504268    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/afe82602-f930-4bde-8f2f-7bc4ddc70347-kube-api-access-klldq\" (UniqueName: \"kubernetes.io/projected/afe82602-f930-4bde-8f2f-7bc4ddc70347-kube-api-access-klldq\") pod \"afe82602-f930-4bde-8f2f-7bc4ddc70347\" (UID: \"afe82602-f930-4bde-8f2f-7bc4ddc70347\") "
Nov 03 18:21:52.504684 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.504619    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-credential-socket" pod "afe82602-f930-4bde-8f2f-7bc4ddc70347" (UID: "afe82602-f930-4bde-8f2f-7bc4ddc70347"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:21:52.504684 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.504634    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-workload-certs" pod "afe82602-f930-4bde-8f2f-7bc4ddc70347" (UID: "afe82602-f930-4bde-8f2f-7bc4ddc70347"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:21:52.504802 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.504702    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-data" pod "afe82602-f930-4bde-8f2f-7bc4ddc70347" (UID: "afe82602-f930-4bde-8f2f-7bc4ddc70347"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:21:52.504802 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.504391    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afe82602-f930-4bde-8f2f-7bc4ddc70347-istiod-ca-cert" pod "afe82602-f930-4bde-8f2f-7bc4ddc70347" (UID: "afe82602-f930-4bde-8f2f-7bc4ddc70347"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 18:21:52.504802 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.504788    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-workload-socket" pod "afe82602-f930-4bde-8f2f-7bc4ddc70347" (UID: "afe82602-f930-4bde-8f2f-7bc4ddc70347"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:21:52.506581 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.506553    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-envoy" pod "afe82602-f930-4bde-8f2f-7bc4ddc70347" (UID: "afe82602-f930-4bde-8f2f-7bc4ddc70347"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:21:52.506731 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.506672    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-podinfo" pod "afe82602-f930-4bde-8f2f-7bc4ddc70347" (UID: "afe82602-f930-4bde-8f2f-7bc4ddc70347"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 18:21:52.506731 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.506683    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afe82602-f930-4bde-8f2f-7bc4ddc70347-kube-api-access-klldq" pod "afe82602-f930-4bde-8f2f-7bc4ddc70347" (UID: "afe82602-f930-4bde-8f2f-7bc4ddc70347"). InnerVolumeSpecName "kube-api-access-klldq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:21:52.506994 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.506972    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-token" pod "afe82602-f930-4bde-8f2f-7bc4ddc70347" (UID: "afe82602-f930-4bde-8f2f-7bc4ddc70347"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:21:52.605166 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.605129    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:21:52.605166 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.605165    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:21:52.605419 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.605180    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:21:52.605419 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.605194    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klldq\" (UniqueName: \"kubernetes.io/projected/afe82602-f930-4bde-8f2f-7bc4ddc70347-kube-api-access-klldq\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:21:52.605419 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.605209    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afe82602-f930-4bde-8f2f-7bc4ddc70347-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:21:52.605419 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.605244    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:21:52.605419 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.605254    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:21:52.605419 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.605263    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:21:52.605419 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:52.605272    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afe82602-f930-4bde-8f2f-7bc4ddc70347-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:21:53.319619 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:53.319592    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"
Nov 03 18:21:53.320048 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:53.319631    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82" event={"ID":"afe82602-f930-4bde-8f2f-7bc4ddc70347","Type":"ContainerDied","Data":"5550d3ffc8306db14d00faa893386daa567a780b61dbe1f42db503f3e1afa22a"}
Nov 03 18:21:53.320048 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:53.319692    5021 scope.go:122] "RemoveContainer" containerID="a9f05e7dbf3eca9a8a91cdefd3a03a8faf858ffe3019d7668171a393b642aa0a"
Nov 03 18:21:53.549625 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:53.549589    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"]
Nov 03 18:21:53.602804 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:53.602727    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xrz82"]
Nov 03 18:21:54.001959 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:21:54.001928    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="afe82602-f930-4bde-8f2f-7bc4ddc70347" path="/var/lib/kubelet/pods/afe82602-f930-4bde-8f2f-7bc4ddc70347/volumes"
Nov 03 18:22:07.045406 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:22:07.045372    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:22:37.046324 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:22:37.046287    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:23:07.045119 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:23:07.045083    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:23:37.045258 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:23:37.045165    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:24:07.046159 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:24:07.046097    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:24:37.045619 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:24:37.045577    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:25:07.046417 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:25:07.046338    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:25:37.045605 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:25:37.045566    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:26:07.046207 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:26:07.046170    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:26:37.045480 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:26:37.045438    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:26:40.565105 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:26:40.564985    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:26:40.578344 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:26:40.578321    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:27:05.323992 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:05.323955    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"]
Nov 03 18:27:07.046294 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:27:07.046259    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:27:10.325018 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:10.324973    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj" podUID="61d174d5-ff58-4d7f-b821-c30c2ba74ba7" containerName="payload-processing" containerID="cri-o://7c92c9a3855c9338776909701f0e6a0ddd2b1f38c7cb56da8665b5c156513022" gracePeriod=25
Nov 03 18:27:15.528337 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:15.528303    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"]
Nov 03 18:27:15.528801 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:15.528562    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849" podUID="8f9281de-ca0d-436e-b6d2-c0e371cc8bfd" containerName="maas-api" containerID="cri-o://d8451349b30ff0e304bf4e3457c0417401665b7a6bc700c47bed9ee647618bd8" gracePeriod=30
Nov 03 18:27:15.785768 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:15.785700    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 18:27:15.972265 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:15.972218    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-metrics-certs\") pod \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\" (UID: \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\") "
Nov 03 18:27:15.972464 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:15.972345    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-kube-api-access-cw7px\" (UniqueName: \"kubernetes.io/projected/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-kube-api-access-cw7px\") pod \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\" (UID: \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\") "
Nov 03 18:27:15.972464 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:15.972372    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-maas-api-tls\") pod \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\" (UID: \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\") "
Nov 03 18:27:15.972464 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:15.972434    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-openshift-service-ca\") pod \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\" (UID: \"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd\") "
Nov 03 18:27:15.972869 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:15.972844    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-openshift-service-ca" pod "8f9281de-ca0d-436e-b6d2-c0e371cc8bfd" (UID: "8f9281de-ca0d-436e-b6d2-c0e371cc8bfd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 18:27:15.974549 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:15.974507    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-maas-api-tls" pod "8f9281de-ca0d-436e-b6d2-c0e371cc8bfd" (UID: "8f9281de-ca0d-436e-b6d2-c0e371cc8bfd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 18:27:15.974648 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:15.974599    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-kube-api-access-cw7px" pod "8f9281de-ca0d-436e-b6d2-c0e371cc8bfd" (UID: "8f9281de-ca0d-436e-b6d2-c0e371cc8bfd"). InnerVolumeSpecName "kube-api-access-cw7px". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:27:15.974753 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:15.974729    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-metrics-certs" pod "8f9281de-ca0d-436e-b6d2-c0e371cc8bfd" (UID: "8f9281de-ca0d-436e-b6d2-c0e371cc8bfd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 18:27:16.055728 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:16.055642    5021 generic.go:356] "Generic (PLEG): container finished" podID="8f9281de-ca0d-436e-b6d2-c0e371cc8bfd" containerID="d8451349b30ff0e304bf4e3457c0417401665b7a6bc700c47bed9ee647618bd8" exitCode=0
Nov 03 18:27:16.055728 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:16.055689    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"
Nov 03 18:27:16.055941 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:16.055725    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849" event={"ID":"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd","Type":"ContainerDied","Data":"d8451349b30ff0e304bf4e3457c0417401665b7a6bc700c47bed9ee647618bd8"}
Nov 03 18:27:16.055941 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:16.055781    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849" event={"ID":"8f9281de-ca0d-436e-b6d2-c0e371cc8bfd","Type":"ContainerDied","Data":"ec79105362aeda0db588bbf8ac2f46a132c83197322fc6ac887915b74e0b7329"}
Nov 03 18:27:16.055941 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:16.055805    5021 scope.go:122] "RemoveContainer" containerID="d8451349b30ff0e304bf4e3457c0417401665b7a6bc700c47bed9ee647618bd8"
Nov 03 18:27:16.065482 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:16.065458    5021 scope.go:122] "RemoveContainer" containerID="d8451349b30ff0e304bf4e3457c0417401665b7a6bc700c47bed9ee647618bd8"
Nov 03 18:27:16.065761 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:27:16.065741    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8451349b30ff0e304bf4e3457c0417401665b7a6bc700c47bed9ee647618bd8\": container with ID starting with d8451349b30ff0e304bf4e3457c0417401665b7a6bc700c47bed9ee647618bd8 not found: ID does not exist" containerID="d8451349b30ff0e304bf4e3457c0417401665b7a6bc700c47bed9ee647618bd8"
Nov 03 18:27:16.065835 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:16.065770    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8451349b30ff0e304bf4e3457c0417401665b7a6bc700c47bed9ee647618bd8"} err="failed to get container status \"d8451349b30ff0e304bf4e3457c0417401665b7a6bc700c47bed9ee647618bd8\": rpc error: code = NotFound desc = could not find container \"d8451349b30ff0e304bf4e3457c0417401665b7a6bc700c47bed9ee647618bd8\": container with ID starting with d8451349b30ff0e304bf4e3457c0417401665b7a6bc700c47bed9ee647618bd8 not found: ID does not exist"
Nov 03 18:27:16.073395 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:16.073374    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cw7px\" (UniqueName: \"kubernetes.io/projected/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-kube-api-access-cw7px\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:27:16.073471 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:16.073396    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:27:16.073471 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:16.073406    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:27:16.073471 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:16.073414    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:27:16.230979 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:16.230944    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"]
Nov 03 18:27:16.235035 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:16.235007    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-029ca0-8548c8dd4d-jz849"]
Nov 03 18:27:17.025045 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:17.025005    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj" podUID="61d174d5-ff58-4d7f-b821-c30c2ba74ba7" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 18:27:18.002459 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:18.002426    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8f9281de-ca0d-436e-b6d2-c0e371cc8bfd" path="/var/lib/kubelet/pods/8f9281de-ca0d-436e-b6d2-c0e371cc8bfd/volumes"
Nov 03 18:27:27.024992 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:27.024949    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj" podUID="61d174d5-ff58-4d7f-b821-c30c2ba74ba7" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 18:27:30.580639 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:30.580613    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"
Nov 03 18:27:30.699220 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:30.699133    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61d174d5-ff58-4d7f-b821-c30c2ba74ba7-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61d174d5-ff58-4d7f-b821-c30c2ba74ba7-plugins-config-volume\") pod \"61d174d5-ff58-4d7f-b821-c30c2ba74ba7\" (UID: \"61d174d5-ff58-4d7f-b821-c30c2ba74ba7\") "
Nov 03 18:27:30.699418 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:30.699272    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61d174d5-ff58-4d7f-b821-c30c2ba74ba7-kube-api-access-vz52w\" (UniqueName: \"kubernetes.io/projected/61d174d5-ff58-4d7f-b821-c30c2ba74ba7-kube-api-access-vz52w\") pod \"61d174d5-ff58-4d7f-b821-c30c2ba74ba7\" (UID: \"61d174d5-ff58-4d7f-b821-c30c2ba74ba7\") "
Nov 03 18:27:30.699624 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:30.699595    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61d174d5-ff58-4d7f-b821-c30c2ba74ba7-plugins-config-volume" pod "61d174d5-ff58-4d7f-b821-c30c2ba74ba7" (UID: "61d174d5-ff58-4d7f-b821-c30c2ba74ba7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 18:27:30.701442 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:30.701417    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61d174d5-ff58-4d7f-b821-c30c2ba74ba7-kube-api-access-vz52w" pod "61d174d5-ff58-4d7f-b821-c30c2ba74ba7" (UID: "61d174d5-ff58-4d7f-b821-c30c2ba74ba7"). InnerVolumeSpecName "kube-api-access-vz52w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:27:30.800657 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:30.800621    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz52w\" (UniqueName: \"kubernetes.io/projected/61d174d5-ff58-4d7f-b821-c30c2ba74ba7-kube-api-access-vz52w\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:27:30.800657 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:30.800653    5021 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61d174d5-ff58-4d7f-b821-c30c2ba74ba7-plugins-config-volume\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:27:31.133477 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:31.133443    5021 generic.go:356] "Generic (PLEG): container finished" podID="61d174d5-ff58-4d7f-b821-c30c2ba74ba7" containerID="7c92c9a3855c9338776909701f0e6a0ddd2b1f38c7cb56da8665b5c156513022" exitCode=0
Nov 03 18:27:31.133659 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:31.133486    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"
Nov 03 18:27:31.133659 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:31.133530    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj" event={"ID":"61d174d5-ff58-4d7f-b821-c30c2ba74ba7","Type":"ContainerDied","Data":"7c92c9a3855c9338776909701f0e6a0ddd2b1f38c7cb56da8665b5c156513022"}
Nov 03 18:27:31.133659 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:31.133583    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj" event={"ID":"61d174d5-ff58-4d7f-b821-c30c2ba74ba7","Type":"ContainerDied","Data":"6beac8013bc4985b1a7d0e86d9b2e35cf55f511f6fcdaec025bdaef5acf49be7"}
Nov 03 18:27:31.133659 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:31.133607    5021 scope.go:122] "RemoveContainer" containerID="7c92c9a3855c9338776909701f0e6a0ddd2b1f38c7cb56da8665b5c156513022"
Nov 03 18:27:31.145818 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:31.145799    5021 scope.go:122] "RemoveContainer" containerID="7c92c9a3855c9338776909701f0e6a0ddd2b1f38c7cb56da8665b5c156513022"
Nov 03 18:27:31.146125 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:27:31.146108    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c92c9a3855c9338776909701f0e6a0ddd2b1f38c7cb56da8665b5c156513022\": container with ID starting with 7c92c9a3855c9338776909701f0e6a0ddd2b1f38c7cb56da8665b5c156513022 not found: ID does not exist" containerID="7c92c9a3855c9338776909701f0e6a0ddd2b1f38c7cb56da8665b5c156513022"
Nov 03 18:27:31.146201 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:31.146139    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c92c9a3855c9338776909701f0e6a0ddd2b1f38c7cb56da8665b5c156513022"} err="failed to get container status \"7c92c9a3855c9338776909701f0e6a0ddd2b1f38c7cb56da8665b5c156513022\": rpc error: code = NotFound desc = could not find container \"7c92c9a3855c9338776909701f0e6a0ddd2b1f38c7cb56da8665b5c156513022\": container with ID starting with 7c92c9a3855c9338776909701f0e6a0ddd2b1f38c7cb56da8665b5c156513022 not found: ID does not exist"
Nov 03 18:27:31.307664 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:31.307629    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"]
Nov 03 18:27:31.360770 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:31.360737    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-029ca0-57bf9b4f49-j48rj"]
Nov 03 18:27:32.002374 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:32.002335    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="61d174d5-ff58-4d7f-b821-c30c2ba74ba7" path="/var/lib/kubelet/pods/61d174d5-ff58-4d7f-b821-c30c2ba74ba7/volumes"
Nov 03 18:27:36.728587 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:36.728551    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"]
Nov 03 18:27:36.729094 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:36.728805    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt" podUID="d90cf5c8-5c49-4e06-8d36-73692a13e8c6" containerName="maas-api" containerID="cri-o://4714766fb6a73e7ebc3a3759eb06e70146d08deda163cd65cba92c8766e13e7b" gracePeriod=30
Nov 03 18:27:36.988329 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:36.988269    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 18:27:37.044849 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:27:37.044814    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:27:37.057868 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.057844    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-kube-api-access-rbk8j\" (UniqueName: \"kubernetes.io/projected/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-kube-api-access-rbk8j\") pod \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\" (UID: \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\") "
Nov 03 18:27:37.058018 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.057935    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-maas-api-tls\") pod \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\" (UID: \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\") "
Nov 03 18:27:37.058018 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.057957    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-openshift-service-ca\") pod \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\" (UID: \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\") "
Nov 03 18:27:37.058155 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.058068    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-metrics-certs\") pod \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\" (UID: \"d90cf5c8-5c49-4e06-8d36-73692a13e8c6\") "
Nov 03 18:27:37.058345 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.058316    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-openshift-service-ca" pod "d90cf5c8-5c49-4e06-8d36-73692a13e8c6" (UID: "d90cf5c8-5c49-4e06-8d36-73692a13e8c6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 18:27:37.058489 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.058469    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:27:37.059975 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.059947    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-metrics-certs" pod "d90cf5c8-5c49-4e06-8d36-73692a13e8c6" (UID: "d90cf5c8-5c49-4e06-8d36-73692a13e8c6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 18:27:37.060087 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.059991    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-kube-api-access-rbk8j" pod "d90cf5c8-5c49-4e06-8d36-73692a13e8c6" (UID: "d90cf5c8-5c49-4e06-8d36-73692a13e8c6"). InnerVolumeSpecName "kube-api-access-rbk8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:27:37.060087 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.060030    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-maas-api-tls" pod "d90cf5c8-5c49-4e06-8d36-73692a13e8c6" (UID: "d90cf5c8-5c49-4e06-8d36-73692a13e8c6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 18:27:37.159597 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.159565    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbk8j\" (UniqueName: \"kubernetes.io/projected/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-kube-api-access-rbk8j\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:27:37.159597 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.159592    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:27:37.159597 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.159602    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d90cf5c8-5c49-4e06-8d36-73692a13e8c6-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:27:37.165635 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.165596    5021 generic.go:356] "Generic (PLEG): container finished" podID="d90cf5c8-5c49-4e06-8d36-73692a13e8c6" containerID="4714766fb6a73e7ebc3a3759eb06e70146d08deda163cd65cba92c8766e13e7b" exitCode=0
Nov 03 18:27:37.165781 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.165643    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"
Nov 03 18:27:37.165781 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.165672    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt" event={"ID":"d90cf5c8-5c49-4e06-8d36-73692a13e8c6","Type":"ContainerDied","Data":"4714766fb6a73e7ebc3a3759eb06e70146d08deda163cd65cba92c8766e13e7b"}
Nov 03 18:27:37.165781 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.165723    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt" event={"ID":"d90cf5c8-5c49-4e06-8d36-73692a13e8c6","Type":"ContainerDied","Data":"d289f229aba5078c79c1d315da5f73eebe17fbdf305b106d47eaa18e5a9c33a0"}
Nov 03 18:27:37.165781 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.165744    5021 scope.go:122] "RemoveContainer" containerID="4714766fb6a73e7ebc3a3759eb06e70146d08deda163cd65cba92c8766e13e7b"
Nov 03 18:27:37.175792 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.175773    5021 scope.go:122] "RemoveContainer" containerID="4714766fb6a73e7ebc3a3759eb06e70146d08deda163cd65cba92c8766e13e7b"
Nov 03 18:27:37.176062 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:27:37.176038    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4714766fb6a73e7ebc3a3759eb06e70146d08deda163cd65cba92c8766e13e7b\": container with ID starting with 4714766fb6a73e7ebc3a3759eb06e70146d08deda163cd65cba92c8766e13e7b not found: ID does not exist" containerID="4714766fb6a73e7ebc3a3759eb06e70146d08deda163cd65cba92c8766e13e7b"
Nov 03 18:27:37.176110 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.176071    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4714766fb6a73e7ebc3a3759eb06e70146d08deda163cd65cba92c8766e13e7b"} err="failed to get container status \"4714766fb6a73e7ebc3a3759eb06e70146d08deda163cd65cba92c8766e13e7b\": rpc error: code = NotFound desc = could not find container \"4714766fb6a73e7ebc3a3759eb06e70146d08deda163cd65cba92c8766e13e7b\": container with ID starting with 4714766fb6a73e7ebc3a3759eb06e70146d08deda163cd65cba92c8766e13e7b not found: ID does not exist"
Nov 03 18:27:37.340595 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.340563    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"]
Nov 03 18:27:37.347080 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:37.347045    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-8c9b0f-86f6bb7dd4-925dt"]
Nov 03 18:27:38.002857 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:38.002823    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d90cf5c8-5c49-4e06-8d36-73692a13e8c6" path="/var/lib/kubelet/pods/d90cf5c8-5c49-4e06-8d36-73692a13e8c6/volumes"
Nov 03 18:27:43.644424 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:43.644387    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56c4996b4f-m8ksh_9f57c4b3-a9e2-4e43-ac33-3f75957f0668/authorino/0.log"
Nov 03 18:27:46.434448 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:46.434418    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-bbqqn_21278b76-fc4f-45fc-96d3-e8898bead3dd/manager/0.log"
Nov 03 18:27:49.120891 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:49.120815    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-kfwnf_449ee7b6-e6dd-4aef-933c-722a0eb63ae1/server/0.log"
Nov 03 18:27:49.353451 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:49.353414    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-sg7cz_321a5ab2-29da-497d-83ac-68121f5fe200/manager/0.log"
Nov 03 18:27:49.752529 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:27:49.752496    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-jvcqp_782d07ab-b807-400c-b2b2-74989c3f84e9/proxy/0.log"
Nov 03 18:28:04.384379 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.384341    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"]
Nov 03 18:28:04.384811 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.384796    5021 cpu_manager.go:414] "containerMap: removing container" podUID="61d174d5-ff58-4d7f-b821-c30c2ba74ba7" containerName="payload-processing"
Nov 03 18:28:04.384870 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.384812    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61d174d5-ff58-4d7f-b821-c30c2ba74ba7" containerName="payload-processing"
Nov 03 18:28:04.384870 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.384821    5021 cpu_manager.go:414] "containerMap: removing container" podUID="8f9281de-ca0d-436e-b6d2-c0e371cc8bfd" containerName="maas-api"
Nov 03 18:28:04.384870 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.384829    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f9281de-ca0d-436e-b6d2-c0e371cc8bfd" containerName="maas-api"
Nov 03 18:28:04.384870 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.384844    5021 cpu_manager.go:414] "containerMap: removing container" podUID="afe82602-f930-4bde-8f2f-7bc4ddc70347" containerName="istio-proxy"
Nov 03 18:28:04.384870 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.384849    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="afe82602-f930-4bde-8f2f-7bc4ddc70347" containerName="istio-proxy"
Nov 03 18:28:04.384870 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.384858    5021 cpu_manager.go:414] "containerMap: removing container" podUID="d90cf5c8-5c49-4e06-8d36-73692a13e8c6" containerName="maas-api"
Nov 03 18:28:04.384870 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.384863    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d90cf5c8-5c49-4e06-8d36-73692a13e8c6" containerName="maas-api"
Nov 03 18:28:04.385087 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.384879    5021 cpu_manager.go:414] "containerMap: removing container" podUID="57458b9b-d189-4308-9023-d94e3900b98c" containerName="istio-proxy"
Nov 03 18:28:04.385087 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.384883    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="57458b9b-d189-4308-9023-d94e3900b98c" containerName="istio-proxy"
Nov 03 18:28:04.385087 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.384964    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="57458b9b-d189-4308-9023-d94e3900b98c" containerName="istio-proxy"
Nov 03 18:28:04.385087 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.384976    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="afe82602-f930-4bde-8f2f-7bc4ddc70347" containerName="istio-proxy"
Nov 03 18:28:04.385087 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.384986    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="61d174d5-ff58-4d7f-b821-c30c2ba74ba7" containerName="payload-processing"
Nov 03 18:28:04.385087 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.384996    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="8f9281de-ca0d-436e-b6d2-c0e371cc8bfd" containerName="maas-api"
Nov 03 18:28:04.385087 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.385001    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="d90cf5c8-5c49-4e06-8d36-73692a13e8c6" containerName="maas-api"
Nov 03 18:28:04.388172 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.388153    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:04.414044 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.414015    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggmn9\" (UniqueName: \"kubernetes.io/projected/46325bd1-7604-4203-86d7-52f0b935a618-kube-api-access-ggmn9\") pod \"maas-api-e2e-ait-007400fa-5c585899cd-n9fc7\" (UID: \"46325bd1-7604-4203-86d7-52f0b935a618\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:04.414166 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.414116    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46325bd1-7604-4203-86d7-52f0b935a618-metrics-certs\") pod \"maas-api-e2e-ait-007400fa-5c585899cd-n9fc7\" (UID: \"46325bd1-7604-4203-86d7-52f0b935a618\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:04.414220 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.414174    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46325bd1-7604-4203-86d7-52f0b935a618-openshift-service-ca\") pod \"maas-api-e2e-ait-007400fa-5c585899cd-n9fc7\" (UID: \"46325bd1-7604-4203-86d7-52f0b935a618\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:04.414293 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.414248    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46325bd1-7604-4203-86d7-52f0b935a618-maas-api-tls\") pod \"maas-api-e2e-ait-007400fa-5c585899cd-n9fc7\" (UID: \"46325bd1-7604-4203-86d7-52f0b935a618\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:04.444716 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.444689    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"]
Nov 03 18:28:04.496041 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.496012    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-007400fa-serving-cert\""
Nov 03 18:28:04.515486 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.515456    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46325bd1-7604-4203-86d7-52f0b935a618-openshift-service-ca\") pod \"maas-api-e2e-ait-007400fa-5c585899cd-n9fc7\" (UID: \"46325bd1-7604-4203-86d7-52f0b935a618\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:04.515654 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.515528    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46325bd1-7604-4203-86d7-52f0b935a618-maas-api-tls\") pod \"maas-api-e2e-ait-007400fa-5c585899cd-n9fc7\" (UID: \"46325bd1-7604-4203-86d7-52f0b935a618\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:04.515654 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.515596    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggmn9\" (UniqueName: \"kubernetes.io/projected/46325bd1-7604-4203-86d7-52f0b935a618-kube-api-access-ggmn9\") pod \"maas-api-e2e-ait-007400fa-5c585899cd-n9fc7\" (UID: \"46325bd1-7604-4203-86d7-52f0b935a618\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:04.515775 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.515660    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46325bd1-7604-4203-86d7-52f0b935a618-metrics-certs\") pod \"maas-api-e2e-ait-007400fa-5c585899cd-n9fc7\" (UID: \"46325bd1-7604-4203-86d7-52f0b935a618\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:04.515775 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:28:04.515689    5021 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-serving-cert: secret "maas-api-e2e-ait-007400fa-serving-cert" not found
Nov 03 18:28:04.515775 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:28:04.515757    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46325bd1-7604-4203-86d7-52f0b935a618-maas-api-tls podName:46325bd1-7604-4203-86d7-52f0b935a618 nodeName:}" failed. No retries permitted until 2026-11-03 18:28:05.015737483 +0000 UTC m=+4285.217075529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/46325bd1-7604-4203-86d7-52f0b935a618-maas-api-tls") pod "maas-api-e2e-ait-007400fa-5c585899cd-n9fc7" (UID: "46325bd1-7604-4203-86d7-52f0b935a618") : secret "maas-api-e2e-ait-007400fa-serving-cert" not found
Nov 03 18:28:04.516359 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.516333    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46325bd1-7604-4203-86d7-52f0b935a618-openshift-service-ca\") pod \"maas-api-e2e-ait-007400fa-5c585899cd-n9fc7\" (UID: \"46325bd1-7604-4203-86d7-52f0b935a618\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:04.518338 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.518309    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46325bd1-7604-4203-86d7-52f0b935a618-metrics-certs\") pod \"maas-api-e2e-ait-007400fa-5c585899cd-n9fc7\" (UID: \"46325bd1-7604-4203-86d7-52f0b935a618\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:04.582317 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:04.582279    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggmn9\" (UniqueName: \"kubernetes.io/projected/46325bd1-7604-4203-86d7-52f0b935a618-kube-api-access-ggmn9\") pod \"maas-api-e2e-ait-007400fa-5c585899cd-n9fc7\" (UID: \"46325bd1-7604-4203-86d7-52f0b935a618\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:05.019535 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:05.019502    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46325bd1-7604-4203-86d7-52f0b935a618-maas-api-tls\") pod \"maas-api-e2e-ait-007400fa-5c585899cd-n9fc7\" (UID: \"46325bd1-7604-4203-86d7-52f0b935a618\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:05.021932 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:05.021906    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46325bd1-7604-4203-86d7-52f0b935a618-maas-api-tls\") pod \"maas-api-e2e-ait-007400fa-5c585899cd-n9fc7\" (UID: \"46325bd1-7604-4203-86d7-52f0b935a618\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:05.300559 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:05.300473    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:05.680058 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:05.680022    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"]
Nov 03 18:28:05.680498 ip-10-0-137-219 kubenswrapper[5021]: W1103 18:28:05.680370    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46325bd1_7604_4203_86d7_52f0b935a618.slice/crio-7bdcd039aed91079cc733fbfc7860cbd5a2fdaefffb05645d1f1f3caa2d54a33 WatchSource:0}: Error finding container 7bdcd039aed91079cc733fbfc7860cbd5a2fdaefffb05645d1f1f3caa2d54a33: Status 404 returned error can't find the container with id 7bdcd039aed91079cc733fbfc7860cbd5a2fdaefffb05645d1f1f3caa2d54a33
Nov 03 18:28:05.682000 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:05.681979    5021 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 18:28:06.327094 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:06.327061    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7" event={"ID":"46325bd1-7604-4203-86d7-52f0b935a618","Type":"ContainerStarted","Data":"7bdcd039aed91079cc733fbfc7860cbd5a2fdaefffb05645d1f1f3caa2d54a33"}
Nov 03 18:28:07.045095 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:28:07.045044    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:28:07.338602 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:07.338512    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7" event={"ID":"46325bd1-7604-4203-86d7-52f0b935a618","Type":"ContainerStarted","Data":"62a9fc274534a5bd4500a8781bfe0a8b35b00f4c7fda39891c5b1082dd56e4dc"}
Nov 03 18:28:07.338773 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:07.338639    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:07.463097 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:07.463046    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7" podStartSLOduration=2.5741519999999998 podStartE2EDuration="3.463032746s" totalImagesPullingTime="888.880746ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 18:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 18:28:07.462660492 +0000 UTC m=+4287.663998546" watchObservedRunningTime="2026-11-03 18:28:07.463032746 +0000 UTC m=+4287.664370797"
Nov 03 18:28:13.350174 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:13.350127    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:37.046423 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:28:37.046382    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:28:52.947517 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:52.947483    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"]
Nov 03 18:28:52.948082 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:52.947691    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7" podUID="46325bd1-7604-4203-86d7-52f0b935a618" containerName="maas-api" containerID="cri-o://62a9fc274534a5bd4500a8781bfe0a8b35b00f4c7fda39891c5b1082dd56e4dc" gracePeriod=30
Nov 03 18:28:53.221741 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.221716    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:53.269703 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.269669    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/46325bd1-7604-4203-86d7-52f0b935a618-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46325bd1-7604-4203-86d7-52f0b935a618-maas-api-tls\") pod \"46325bd1-7604-4203-86d7-52f0b935a618\" (UID: \"46325bd1-7604-4203-86d7-52f0b935a618\") "
Nov 03 18:28:53.269885 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.269721    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/46325bd1-7604-4203-86d7-52f0b935a618-metrics-certs\" (UniqueName: \"kubernetes.io/secret/46325bd1-7604-4203-86d7-52f0b935a618-metrics-certs\") pod \"46325bd1-7604-4203-86d7-52f0b935a618\" (UID: \"46325bd1-7604-4203-86d7-52f0b935a618\") "
Nov 03 18:28:53.269885 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.269743    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/46325bd1-7604-4203-86d7-52f0b935a618-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46325bd1-7604-4203-86d7-52f0b935a618-openshift-service-ca\") pod \"46325bd1-7604-4203-86d7-52f0b935a618\" (UID: \"46325bd1-7604-4203-86d7-52f0b935a618\") "
Nov 03 18:28:53.269885 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.269790    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/46325bd1-7604-4203-86d7-52f0b935a618-kube-api-access-ggmn9\" (UniqueName: \"kubernetes.io/projected/46325bd1-7604-4203-86d7-52f0b935a618-kube-api-access-ggmn9\") pod \"46325bd1-7604-4203-86d7-52f0b935a618\" (UID: \"46325bd1-7604-4203-86d7-52f0b935a618\") "
Nov 03 18:28:53.270211 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.270188    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46325bd1-7604-4203-86d7-52f0b935a618-openshift-service-ca" pod "46325bd1-7604-4203-86d7-52f0b935a618" (UID: "46325bd1-7604-4203-86d7-52f0b935a618"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 18:28:53.271839 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.271816    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46325bd1-7604-4203-86d7-52f0b935a618-maas-api-tls" pod "46325bd1-7604-4203-86d7-52f0b935a618" (UID: "46325bd1-7604-4203-86d7-52f0b935a618"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 18:28:53.271934 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.271837    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46325bd1-7604-4203-86d7-52f0b935a618-metrics-certs" pod "46325bd1-7604-4203-86d7-52f0b935a618" (UID: "46325bd1-7604-4203-86d7-52f0b935a618"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 18:28:53.271978 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.271928    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46325bd1-7604-4203-86d7-52f0b935a618-kube-api-access-ggmn9" pod "46325bd1-7604-4203-86d7-52f0b935a618" (UID: "46325bd1-7604-4203-86d7-52f0b935a618"). InnerVolumeSpecName "kube-api-access-ggmn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:28:53.370782 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.370738    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggmn9\" (UniqueName: \"kubernetes.io/projected/46325bd1-7604-4203-86d7-52f0b935a618-kube-api-access-ggmn9\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:28:53.370782 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.370769    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46325bd1-7604-4203-86d7-52f0b935a618-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:28:53.370782 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.370783    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46325bd1-7604-4203-86d7-52f0b935a618-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:28:53.370782 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.370792    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46325bd1-7604-4203-86d7-52f0b935a618-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:28:53.575958 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.575924    5021 generic.go:356] "Generic (PLEG): container finished" podID="46325bd1-7604-4203-86d7-52f0b935a618" containerID="62a9fc274534a5bd4500a8781bfe0a8b35b00f4c7fda39891c5b1082dd56e4dc" exitCode=0
Nov 03 18:28:53.576134 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.575971    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"
Nov 03 18:28:53.576134 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.576005    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7" event={"ID":"46325bd1-7604-4203-86d7-52f0b935a618","Type":"ContainerDied","Data":"62a9fc274534a5bd4500a8781bfe0a8b35b00f4c7fda39891c5b1082dd56e4dc"}
Nov 03 18:28:53.576134 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.576065    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7" event={"ID":"46325bd1-7604-4203-86d7-52f0b935a618","Type":"ContainerDied","Data":"7bdcd039aed91079cc733fbfc7860cbd5a2fdaefffb05645d1f1f3caa2d54a33"}
Nov 03 18:28:53.576134 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.576093    5021 scope.go:122] "RemoveContainer" containerID="62a9fc274534a5bd4500a8781bfe0a8b35b00f4c7fda39891c5b1082dd56e4dc"
Nov 03 18:28:53.586971 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.586950    5021 scope.go:122] "RemoveContainer" containerID="62a9fc274534a5bd4500a8781bfe0a8b35b00f4c7fda39891c5b1082dd56e4dc"
Nov 03 18:28:53.587249 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:28:53.587210    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62a9fc274534a5bd4500a8781bfe0a8b35b00f4c7fda39891c5b1082dd56e4dc\": container with ID starting with 62a9fc274534a5bd4500a8781bfe0a8b35b00f4c7fda39891c5b1082dd56e4dc not found: ID does not exist" containerID="62a9fc274534a5bd4500a8781bfe0a8b35b00f4c7fda39891c5b1082dd56e4dc"
Nov 03 18:28:53.587327 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.587263    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a9fc274534a5bd4500a8781bfe0a8b35b00f4c7fda39891c5b1082dd56e4dc"} err="failed to get container status \"62a9fc274534a5bd4500a8781bfe0a8b35b00f4c7fda39891c5b1082dd56e4dc\": rpc error: code = NotFound desc = could not find container \"62a9fc274534a5bd4500a8781bfe0a8b35b00f4c7fda39891c5b1082dd56e4dc\": container with ID starting with 62a9fc274534a5bd4500a8781bfe0a8b35b00f4c7fda39891c5b1082dd56e4dc not found: ID does not exist"
Nov 03 18:28:53.750544 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.750512    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"]
Nov 03 18:28:53.755950 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:53.755921    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-007400fa-5c585899cd-n9fc7"]
Nov 03 18:28:54.001908 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:28:54.001884    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="46325bd1-7604-4203-86d7-52f0b935a618" path="/var/lib/kubelet/pods/46325bd1-7604-4203-86d7-52f0b935a618/volumes"
Nov 03 18:29:07.049367 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:29:07.049325    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:29:37.045256 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:29:37.045154    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:29:50.901885 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:50.901851    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"]
Nov 03 18:29:50.902461 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:50.902349    5021 cpu_manager.go:414] "containerMap: removing container" podUID="46325bd1-7604-4203-86d7-52f0b935a618" containerName="maas-api"
Nov 03 18:29:50.902461 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:50.902363    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46325bd1-7604-4203-86d7-52f0b935a618" containerName="maas-api"
Nov 03 18:29:50.902461 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:50.902449    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="46325bd1-7604-4203-86d7-52f0b935a618" containerName="maas-api"
Nov 03 18:29:50.905541 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:50.905524    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.018298 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.018260    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.018298 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.018301    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72ef520b-730f-45ee-a9cf-08513d927905-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.018570 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.018308    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"]
Nov 03 18:29:51.018570 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.018320    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.018570 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.018409    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8crr\" (UniqueName: \"kubernetes.io/projected/72ef520b-730f-45ee-a9cf-08513d927905-kube-api-access-h8crr\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.018570 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.018471    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.018570 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.018507    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.018759 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.018569    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72ef520b-730f-45ee-a9cf-08513d927905-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.018759 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.018603    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72ef520b-730f-45ee-a9cf-08513d927905-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.018759 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.018686    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.119593 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.119554    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.119775 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.119613    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72ef520b-730f-45ee-a9cf-08513d927905-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.119775 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.119646    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72ef520b-730f-45ee-a9cf-08513d927905-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.119775 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.119677    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.119775 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.119755    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.120006 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.119781    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72ef520b-730f-45ee-a9cf-08513d927905-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.120006 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.119807    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.120006 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.119836    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8crr\" (UniqueName: \"kubernetes.io/projected/72ef520b-730f-45ee-a9cf-08513d927905-kube-api-access-h8crr\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.120006 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.119893    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.120247 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.120064    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.120247 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.120134    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.120247 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.120193    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.120412 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.120311    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.120575 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.120553    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72ef520b-730f-45ee-a9cf-08513d927905-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.122110 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.122086    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.122202 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.122165    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72ef520b-730f-45ee-a9cf-08513d927905-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.185277 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.185206    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72ef520b-730f-45ee-a9cf-08513d927905-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.185402 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.185309    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8crr\" (UniqueName: \"kubernetes.io/projected/72ef520b-730f-45ee-a9cf-08513d927905-kube-api-access-h8crr\") pod \"maas-default-gateway-openshift-default-58c6585447-xhtvr\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.218128 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.218098    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:51.653467 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.653435    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"]
Nov 03 18:29:51.653618 ip-10-0-137-219 kubenswrapper[5021]: W1103 18:29:51.653560    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ef520b_730f_45ee_a9cf_08513d927905.slice/crio-da43564acb7f06a72d54618e07a71b9c7885aa60c4684563f6fefc1852661adc WatchSource:0}: Error finding container da43564acb7f06a72d54618e07a71b9c7885aa60c4684563f6fefc1852661adc: Status 404 returned error can't find the container with id da43564acb7f06a72d54618e07a71b9c7885aa60c4684563f6fefc1852661adc
Nov 03 18:29:51.655607 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.655574    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 18:29:51.655694 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.655639    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 18:29:51.655694 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.655676    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 18:29:51.880716 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.880681    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr" event={"ID":"72ef520b-730f-45ee-a9cf-08513d927905","Type":"ContainerStarted","Data":"ad7e92471a11eb3d977f75f830629fa8f9f6663e1e0672380a87717b321b8e94"}
Nov 03 18:29:51.880897 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:51.880745    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr" event={"ID":"72ef520b-730f-45ee-a9cf-08513d927905","Type":"ContainerStarted","Data":"da43564acb7f06a72d54618e07a71b9c7885aa60c4684563f6fefc1852661adc"}
Nov 03 18:29:52.013028 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:52.012976    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr" podStartSLOduration=2.012962566 podStartE2EDuration="2.012962566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 18:29:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 18:29:52.01255731 +0000 UTC m=+4392.213895376" watchObservedRunningTime="2026-11-03 18:29:52.012962566 +0000 UTC m=+4392.214300617"
Nov 03 18:29:52.218869 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:52.218836    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:29:52.220492 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:52.220464    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xhtvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Nov 03 18:29:52.220644 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:52.220520    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr" podUID="72ef520b-730f-45ee-a9cf-08513d927905" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Nov 03 18:29:53.218539 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:53.218507    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xhtvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Nov 03 18:29:53.218958 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:53.218557    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr" podUID="72ef520b-730f-45ee-a9cf-08513d927905" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Nov 03 18:29:54.218629 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:54.218589    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xhtvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Nov 03 18:29:54.219036 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:54.218642    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr" podUID="72ef520b-730f-45ee-a9cf-08513d927905" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Nov 03 18:29:55.218757 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:55.218719    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xhtvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Nov 03 18:29:55.219164 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:55.218772    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr" podUID="72ef520b-730f-45ee-a9cf-08513d927905" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Nov 03 18:29:56.218863 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:56.218827    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xhtvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Nov 03 18:29:56.219325 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:56.218883    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr" podUID="72ef520b-730f-45ee-a9cf-08513d927905" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Nov 03 18:29:57.219041 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:57.219007    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xhtvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Nov 03 18:29:57.219522 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:57.219084    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr" podUID="72ef520b-730f-45ee-a9cf-08513d927905" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Nov 03 18:29:58.218728 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:58.218684    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xhtvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Nov 03 18:29:58.218916 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:58.218766    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr" podUID="72ef520b-730f-45ee-a9cf-08513d927905" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Nov 03 18:29:59.219442 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:59.219400    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xhtvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Nov 03 18:29:59.219895 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:29:59.219469    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr" podUID="72ef520b-730f-45ee-a9cf-08513d927905" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Nov 03 18:30:00.882133 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:00.882099    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:30:00.882630 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:00.882521    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:30:00.883653 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:00.883629    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 18:30:07.067444 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:30:07.067353    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:30:36.263579 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.263548    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"]
Nov 03 18:30:36.267439 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.267414    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.362319 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.362280    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.362476 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.362332    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.362476 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.362419    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.362562 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.362498    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.362562 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.362520    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.362562 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.362550    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fl8t\" (UniqueName: \"kubernetes.io/projected/64bed658-4022-47d6-84f0-c9d575ffb82d-kube-api-access-2fl8t\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.362655 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.362583    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.362708 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.362686    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.362759 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.362747    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64bed658-4022-47d6-84f0-c9d575ffb82d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.378910 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.378881    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"]
Nov 03 18:30:36.463825 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.463796    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.464008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.463847    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64bed658-4022-47d6-84f0-c9d575ffb82d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.464008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.463900    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.464008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.463920    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.464008 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.463940    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.464210 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.464102    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.464210 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.464153    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.464210 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.464202    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fl8t\" (UniqueName: \"kubernetes.io/projected/64bed658-4022-47d6-84f0-c9d575ffb82d-kube-api-access-2fl8t\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.464431 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.464277    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.464479 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.464429    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.464566 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.464535    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.464630 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.464573    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.466128 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.465086    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64bed658-4022-47d6-84f0-c9d575ffb82d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.466128 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.465115    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.473673 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.473644    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.473853 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.473834    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.528765 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.528689    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.528894 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.528812    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fl8t\" (UniqueName: \"kubernetes.io/projected/64bed658-4022-47d6-84f0-c9d575ffb82d-kube-api-access-2fl8t\") pod \"maas-default-gateway-openshift-default-58c6585447-xr7mz\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:36.581537 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:36.581500    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:37.022201 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:37.022169    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"]
Nov 03 18:30:37.023317 ip-10-0-137-219 kubenswrapper[5021]: W1103 18:30:37.023290    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64bed658_4022_47d6_84f0_c9d575ffb82d.slice/crio-af9e0800877ac832fd06e6750da09613eef516f633970e031ac13be3fb05cd44 WatchSource:0}: Error finding container af9e0800877ac832fd06e6750da09613eef516f633970e031ac13be3fb05cd44: Status 404 returned error can't find the container with id af9e0800877ac832fd06e6750da09613eef516f633970e031ac13be3fb05cd44
Nov 03 18:30:37.025482 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:37.025448    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 18:30:37.025581 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:37.025520    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 18:30:37.025581 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:37.025552    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 18:30:37.047827 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:30:37.047800    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:30:37.132245 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:37.131758    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" event={"ID":"64bed658-4022-47d6-84f0-c9d575ffb82d","Type":"ContainerStarted","Data":"59cd95617fcd98ddcbb5219eadb8664de69143f4e8ce3c81c9b184a5b47283be"}
Nov 03 18:30:37.132245 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:37.131819    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" event={"ID":"64bed658-4022-47d6-84f0-c9d575ffb82d","Type":"ContainerStarted","Data":"af9e0800877ac832fd06e6750da09613eef516f633970e031ac13be3fb05cd44"}
Nov 03 18:30:37.261903 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:37.261834    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podStartSLOduration=1.261816259 podStartE2EDuration="1.261816259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 18:30:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 18:30:37.260658243 +0000 UTC m=+4437.461996295" watchObservedRunningTime="2026-11-03 18:30:37.261816259 +0000 UTC m=+4437.463154313"
Nov 03 18:30:37.581656 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:37.581614    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:38.584365 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:38.584334    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xr7mz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Nov 03 18:30:38.584784 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:38.584387    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Nov 03 18:30:39.582915 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:39.582876    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xr7mz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Nov 03 18:30:39.583103 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:39.582934    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Nov 03 18:30:40.582684 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:40.582644    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xr7mz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Nov 03 18:30:40.583101 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:40.582704    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Nov 03 18:30:41.582511 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:41.582465    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xr7mz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Nov 03 18:30:41.582683 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:41.582532    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Nov 03 18:30:42.582291 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:42.582189    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xr7mz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Nov 03 18:30:42.582653 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:42.582280    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Nov 03 18:30:43.582508 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:43.582467    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xr7mz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Nov 03 18:30:43.583135 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:43.583103    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Nov 03 18:30:44.583562 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:44.583524    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xr7mz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Nov 03 18:30:44.584158 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:44.584122    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Nov 03 18:30:45.664247 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:45.663371    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-sz4qn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 18:30:45.664247 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:45.663476    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" podUID="5bacd2fb-f446-4db3-bb86-92a9d923a034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 18:30:46.631461 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:46.631416    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xr7mz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 18:30:46.631647 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:46.631491    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 18:30:47.633737 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:47.633607    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xr7mz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 18:30:47.635177 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:47.635135    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 18:30:48.676493 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:48.676386    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xr7mz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 18:30:48.676493 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:48.676462    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 18:30:49.718425 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:49.718383    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xr7mz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 18:30:49.718898 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:49.718477    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 18:30:49.885394 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:49.885364    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:49.885765 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:49.885744    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:30:49.886438 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:30:49.886418    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 18:31:07.116929 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:31:07.116892    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:31:36.517162 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:36.517124    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"]
Nov 03 18:31:36.520787 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:36.520761    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"
Nov 03 18:31:36.521599 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:36.521571    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwk89\" (UniqueName: \"kubernetes.io/projected/9f2f85c5-bdb6-42c6-9abb-26d340827fef-kube-api-access-nwk89\") pod \"e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n\" (UID: \"9f2f85c5-bdb6-42c6-9abb-26d340827fef\") " pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"
Nov 03 18:31:36.521722 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:36.521623    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f2f85c5-bdb6-42c6-9abb-26d340827fef-tls-certs\") pod \"e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n\" (UID: \"9f2f85c5-bdb6-42c6-9abb-26d340827fef\") " pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"
Nov 03 18:31:36.575895 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:36.575856    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"]
Nov 03 18:31:36.622393 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:36.622360    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwk89\" (UniqueName: \"kubernetes.io/projected/9f2f85c5-bdb6-42c6-9abb-26d340827fef-kube-api-access-nwk89\") pod \"e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n\" (UID: \"9f2f85c5-bdb6-42c6-9abb-26d340827fef\") " pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"
Nov 03 18:31:36.622597 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:36.622418    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f2f85c5-bdb6-42c6-9abb-26d340827fef-tls-certs\") pod \"e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n\" (UID: \"9f2f85c5-bdb6-42c6-9abb-26d340827fef\") " pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"
Nov 03 18:31:36.626535 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:36.626508    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-prio-pool-0c882e6f-kserve-self-signed-certs\""
Nov 03 18:31:36.626535 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:36.626509    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-prio-pool-0c882e6f-epp-sa-dockercfg-4vtft\""
Nov 03 18:31:36.636087 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:36.636059    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f2f85c5-bdb6-42c6-9abb-26d340827fef-tls-certs\") pod \"e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n\" (UID: \"9f2f85c5-bdb6-42c6-9abb-26d340827fef\") " pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"
Nov 03 18:31:36.687455 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:36.687417    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwk89\" (UniqueName: \"kubernetes.io/projected/9f2f85c5-bdb6-42c6-9abb-26d340827fef-kube-api-access-nwk89\") pod \"e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n\" (UID: \"9f2f85c5-bdb6-42c6-9abb-26d340827fef\") " pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"
Nov 03 18:31:36.837814 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:36.837728    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"
Nov 03 18:31:37.045549 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:31:37.045480    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:31:37.252573 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:37.252547    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"]
Nov 03 18:31:37.255649 ip-10-0-137-219 kubenswrapper[5021]: W1103 18:31:37.255616    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f2f85c5_bdb6_42c6_9abb_26d340827fef.slice/crio-38830d5d3e8664373d81559d26954213255188d0864892b40dde721470168711 WatchSource:0}: Error finding container 38830d5d3e8664373d81559d26954213255188d0864892b40dde721470168711: Status 404 returned error can't find the container with id 38830d5d3e8664373d81559d26954213255188d0864892b40dde721470168711
Nov 03 18:31:37.499495 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:37.499454    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n" event={"ID":"9f2f85c5-bdb6-42c6-9abb-26d340827fef","Type":"ContainerStarted","Data":"38830d5d3e8664373d81559d26954213255188d0864892b40dde721470168711"}
Nov 03 18:31:40.559178 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:40.559139    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n" event={"ID":"9f2f85c5-bdb6-42c6-9abb-26d340827fef","Type":"ContainerStarted","Data":"0a128a8be13643b86bfe4b92d0ce3f718cf65c98112916184aed3228da30df43"}
Nov 03 18:31:40.560623 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:40.560597    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"
Nov 03 18:31:40.687351 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:40.685829    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n" podStartSLOduration=2.334694278 podStartE2EDuration="4.685810351s" totalImagesPullingTime="2.351116073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 18:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 18:31:40.683629569 +0000 UTC m=+4500.884967623" watchObservedRunningTime="2026-11-03 18:31:40.685810351 +0000 UTC m=+4500.887148404"
Nov 03 18:31:40.706522 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:40.706481    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:31:40.711452 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:31:40.711427    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:32:07.045710 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:32:07.045662    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:32:12.601494 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:32:12.601454    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"
Nov 03 18:32:37.045667 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:32:37.045583    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:32:50.483142 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:32:50.483107    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"]
Nov 03 18:32:52.602471 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:32:52.602430    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n" podUID="9f2f85c5-bdb6-42c6-9abb-26d340827fef" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 18:33:00.657492 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:00.657441    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-sz4qn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 18:33:00.658723 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:00.658158    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" podUID="5bacd2fb-f446-4db3-bb86-92a9d923a034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 18:33:02.602489 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:02.602438    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n" podUID="9f2f85c5-bdb6-42c6-9abb-26d340827fef" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 18:33:05.503882 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:05.503821    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n" podUID="9f2f85c5-bdb6-42c6-9abb-26d340827fef" containerName="main" containerID="cri-o://0a128a8be13643b86bfe4b92d0ce3f718cf65c98112916184aed3228da30df43" gracePeriod=45
Nov 03 18:33:07.045579 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:33:07.045543    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:33:12.602388 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:12.602347    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n" podUID="9f2f85c5-bdb6-42c6-9abb-26d340827fef" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 18:33:12.602872 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:12.602478    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"
Nov 03 18:33:22.601687 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:22.601649    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n" podUID="9f2f85c5-bdb6-42c6-9abb-26d340827fef" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 18:33:32.602415 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:32.602369    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n" podUID="9f2f85c5-bdb6-42c6-9abb-26d340827fef" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 18:33:35.754044 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:35.754015    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"
Nov 03 18:33:35.830708 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:35.830628    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9f2f85c5-bdb6-42c6-9abb-26d340827fef-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f2f85c5-bdb6-42c6-9abb-26d340827fef-tls-certs\") pod \"9f2f85c5-bdb6-42c6-9abb-26d340827fef\" (UID: \"9f2f85c5-bdb6-42c6-9abb-26d340827fef\") "
Nov 03 18:33:35.830856 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:35.830748    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f2f85c5-bdb6-42c6-9abb-26d340827fef-kube-api-access-nwk89\" (UniqueName: \"kubernetes.io/projected/9f2f85c5-bdb6-42c6-9abb-26d340827fef-kube-api-access-nwk89\") pod \"9f2f85c5-bdb6-42c6-9abb-26d340827fef\" (UID: \"9f2f85c5-bdb6-42c6-9abb-26d340827fef\") "
Nov 03 18:33:35.832908 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:35.832879    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f2f85c5-bdb6-42c6-9abb-26d340827fef-kube-api-access-nwk89" pod "9f2f85c5-bdb6-42c6-9abb-26d340827fef" (UID: "9f2f85c5-bdb6-42c6-9abb-26d340827fef"). InnerVolumeSpecName "kube-api-access-nwk89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:33:35.833037 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:35.832960    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f2f85c5-bdb6-42c6-9abb-26d340827fef-tls-certs" pod "9f2f85c5-bdb6-42c6-9abb-26d340827fef" (UID: "9f2f85c5-bdb6-42c6-9abb-26d340827fef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 18:33:35.931749 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:35.931710    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwk89\" (UniqueName: \"kubernetes.io/projected/9f2f85c5-bdb6-42c6-9abb-26d340827fef-kube-api-access-nwk89\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:33:35.931749 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:35.931745    5021 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f2f85c5-bdb6-42c6-9abb-26d340827fef-tls-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:33:36.325324 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:36.325283    5021 generic.go:356] "Generic (PLEG): container finished" podID="9f2f85c5-bdb6-42c6-9abb-26d340827fef" containerID="0a128a8be13643b86bfe4b92d0ce3f718cf65c98112916184aed3228da30df43" exitCode=0
Nov 03 18:33:36.325504 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:36.325332    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"
Nov 03 18:33:36.325504 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:36.325376    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n" event={"ID":"9f2f85c5-bdb6-42c6-9abb-26d340827fef","Type":"ContainerDied","Data":"0a128a8be13643b86bfe4b92d0ce3f718cf65c98112916184aed3228da30df43"}
Nov 03 18:33:36.325504 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:36.325424    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n" event={"ID":"9f2f85c5-bdb6-42c6-9abb-26d340827fef","Type":"ContainerDied","Data":"38830d5d3e8664373d81559d26954213255188d0864892b40dde721470168711"}
Nov 03 18:33:36.325504 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:36.325453    5021 scope.go:122] "RemoveContainer" containerID="0a128a8be13643b86bfe4b92d0ce3f718cf65c98112916184aed3228da30df43"
Nov 03 18:33:36.334699 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:36.334671    5021 scope.go:122] "RemoveContainer" containerID="0a128a8be13643b86bfe4b92d0ce3f718cf65c98112916184aed3228da30df43"
Nov 03 18:33:36.334975 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:33:36.334952    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a128a8be13643b86bfe4b92d0ce3f718cf65c98112916184aed3228da30df43\": container with ID starting with 0a128a8be13643b86bfe4b92d0ce3f718cf65c98112916184aed3228da30df43 not found: ID does not exist" containerID="0a128a8be13643b86bfe4b92d0ce3f718cf65c98112916184aed3228da30df43"
Nov 03 18:33:36.335093 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:36.334979    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a128a8be13643b86bfe4b92d0ce3f718cf65c98112916184aed3228da30df43"} err="failed to get container status \"0a128a8be13643b86bfe4b92d0ce3f718cf65c98112916184aed3228da30df43\": rpc error: code = NotFound desc = could not find container \"0a128a8be13643b86bfe4b92d0ce3f718cf65c98112916184aed3228da30df43\": container with ID starting with 0a128a8be13643b86bfe4b92d0ce3f718cf65c98112916184aed3228da30df43 not found: ID does not exist"
Nov 03 18:33:36.499950 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:36.499914    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"]
Nov 03 18:33:36.552995 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:36.552958    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/e2e-prio-pool-0c882e6f-kserve-router-scheduler-579cb85758-fz97n"]
Nov 03 18:33:37.045616 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:33:37.045576    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:33:38.002805 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:38.002773    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f2f85c5-bdb6-42c6-9abb-26d340827fef" path="/var/lib/kubelet/pods/9f2f85c5-bdb6-42c6-9abb-26d340827fef/volumes"
Nov 03 18:33:42.962157 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:42.962121    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"]
Nov 03 18:33:42.962577 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:42.962558    5021 cpu_manager.go:414] "containerMap: removing container" podUID="9f2f85c5-bdb6-42c6-9abb-26d340827fef" containerName="main"
Nov 03 18:33:42.962577 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:42.962570    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f2f85c5-bdb6-42c6-9abb-26d340827fef" containerName="main"
Nov 03 18:33:42.962677 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:42.962666    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f2f85c5-bdb6-42c6-9abb-26d340827fef" containerName="main"
Nov 03 18:33:42.965436 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:42.965418    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.021955 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.021924    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"]
Nov 03 18:33:43.072771 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.072738    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-57d07b\"/\"default-dockercfg-hsgb8\""
Nov 03 18:33:43.072771 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.072738    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-57d07b\"/\"openshift-service-ca.crt\""
Nov 03 18:33:43.072965 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.072829    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-57d07b\"/\"simulator-single-main-57d07b-kserve-self-signed-certs\""
Nov 03 18:33:43.074209 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.074188    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-57d07b\"/\"kube-root-ca.crt\""
Nov 03 18:33:43.106841 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.106801    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdpch\" (UniqueName: \"kubernetes.io/projected/eb5d3803-48f1-4aea-afab-7f55cbd78882-kube-api-access-jdpch\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.107038 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.106943    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb5d3803-48f1-4aea-afab-7f55cbd78882-tls-certs\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.107038 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.107009    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-tmp-dir\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.107145 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.107112    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-home\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.107195 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.107179    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-dshm\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.107262 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.107243    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-model-cache\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.208301 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.208263    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb5d3803-48f1-4aea-afab-7f55cbd78882-tls-certs\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.208301 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.208307    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-tmp-dir\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.208567 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.208330    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-home\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.208567 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.208366    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-dshm\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.208567 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.208392    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-model-cache\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.208567 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.208486    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdpch\" (UniqueName: \"kubernetes.io/projected/eb5d3803-48f1-4aea-afab-7f55cbd78882-kube-api-access-jdpch\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.208805 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.208748    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-tmp-dir\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.208866 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.208811    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-model-cache\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.208866 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.208835    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-home\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.210775 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.210746    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-dshm\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.210947 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.210927    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb5d3803-48f1-4aea-afab-7f55cbd78882-tls-certs\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.273097 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.273053    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdpch\" (UniqueName: \"kubernetes.io/projected/eb5d3803-48f1-4aea-afab-7f55cbd78882-kube-api-access-jdpch\") pod \"simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") " pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.275921 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.275894    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:43.655190 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:43.655160    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"]
Nov 03 18:33:43.655768 ip-10-0-137-219 kubenswrapper[5021]: W1103 18:33:43.655737    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb5d3803_48f1_4aea_afab_7f55cbd78882.slice/crio-079cb506092f5b8ce198f6aaf82f3660ed48b306bef0ade05e5f35359e95d5c4 WatchSource:0}: Error finding container 079cb506092f5b8ce198f6aaf82f3660ed48b306bef0ade05e5f35359e95d5c4: Status 404 returned error can't find the container with id 079cb506092f5b8ce198f6aaf82f3660ed48b306bef0ade05e5f35359e95d5c4
Nov 03 18:33:44.374826 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:44.374780    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw" event={"ID":"eb5d3803-48f1-4aea-afab-7f55cbd78882","Type":"ContainerStarted","Data":"b4a3c684539092eea09c49d714865203e78e599dee9d3c4da83e041b01b6cf17"}
Nov 03 18:33:44.375344 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:44.374833    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw" event={"ID":"eb5d3803-48f1-4aea-afab-7f55cbd78882","Type":"ContainerStarted","Data":"079cb506092f5b8ce198f6aaf82f3660ed48b306bef0ade05e5f35359e95d5c4"}
Nov 03 18:33:44.501436 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:44.501379    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw" podStartSLOduration=2.501365915 podStartE2EDuration="2.501365915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 18:33:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 18:33:44.498903113 +0000 UTC m=+4624.700241166" watchObservedRunningTime="2026-11-03 18:33:44.501365915 +0000 UTC m=+4624.702703968"
Nov 03 18:33:45.276259 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:45.276206    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:53.277030 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:53.276945    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:53.289500 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:53.289472    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:33:53.433392 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:33:53.433358    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:34:07.045169 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:34:07.045131    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:34:37.046014 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:34:37.045974    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:34:45.058532 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:34:45.058487    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"]
Nov 03 18:35:00.078569 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.078524    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw" podUID="eb5d3803-48f1-4aea-afab-7f55cbd78882" containerName="main" containerID="cri-o://b4a3c684539092eea09c49d714865203e78e599dee9d3c4da83e041b01b6cf17" gracePeriod=45
Nov 03 18:35:00.335180 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.335123    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:35:00.476582 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.476551    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eb5d3803-48f1-4aea-afab-7f55cbd78882-kube-api-access-jdpch\" (UniqueName: \"kubernetes.io/projected/eb5d3803-48f1-4aea-afab-7f55cbd78882-kube-api-access-jdpch\") pod \"eb5d3803-48f1-4aea-afab-7f55cbd78882\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") "
Nov 03 18:35:00.476781 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.476661    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eb5d3803-48f1-4aea-afab-7f55cbd78882-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb5d3803-48f1-4aea-afab-7f55cbd78882-tls-certs\") pod \"eb5d3803-48f1-4aea-afab-7f55cbd78882\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") "
Nov 03 18:35:00.476781 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.476710    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-tmp-dir\") pod \"eb5d3803-48f1-4aea-afab-7f55cbd78882\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") "
Nov 03 18:35:00.476781 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.476741    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-dshm\") pod \"eb5d3803-48f1-4aea-afab-7f55cbd78882\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") "
Nov 03 18:35:00.476946 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.476785    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-home\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-home\") pod \"eb5d3803-48f1-4aea-afab-7f55cbd78882\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") "
Nov 03 18:35:00.476946 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.476814    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-model-cache\") pod \"eb5d3803-48f1-4aea-afab-7f55cbd78882\" (UID: \"eb5d3803-48f1-4aea-afab-7f55cbd78882\") "
Nov 03 18:35:00.477120 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.477008    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-tmp-dir" pod "eb5d3803-48f1-4aea-afab-7f55cbd78882" (UID: "eb5d3803-48f1-4aea-afab-7f55cbd78882"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:35:00.477253 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.477202    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-home" pod "eb5d3803-48f1-4aea-afab-7f55cbd78882" (UID: "eb5d3803-48f1-4aea-afab-7f55cbd78882"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:35:00.477253 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.477243    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-model-cache" pod "eb5d3803-48f1-4aea-afab-7f55cbd78882" (UID: "eb5d3803-48f1-4aea-afab-7f55cbd78882"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:35:00.477375 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.477355    5021 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-tmp-dir\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:35:00.479438 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.479407    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb5d3803-48f1-4aea-afab-7f55cbd78882-tls-certs" pod "eb5d3803-48f1-4aea-afab-7f55cbd78882" (UID: "eb5d3803-48f1-4aea-afab-7f55cbd78882"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 18:35:00.479550 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.479458    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb5d3803-48f1-4aea-afab-7f55cbd78882-kube-api-access-jdpch" pod "eb5d3803-48f1-4aea-afab-7f55cbd78882" (UID: "eb5d3803-48f1-4aea-afab-7f55cbd78882"). InnerVolumeSpecName "kube-api-access-jdpch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:35:00.479550 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.479526    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-dshm" pod "eb5d3803-48f1-4aea-afab-7f55cbd78882" (UID: "eb5d3803-48f1-4aea-afab-7f55cbd78882"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:35:00.578164 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.578132    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdpch\" (UniqueName: \"kubernetes.io/projected/eb5d3803-48f1-4aea-afab-7f55cbd78882-kube-api-access-jdpch\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:35:00.578164 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.578162    5021 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb5d3803-48f1-4aea-afab-7f55cbd78882-tls-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:35:00.578164 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.578171    5021 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-dshm\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:35:00.578410 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.578180    5021 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-home\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:35:00.578410 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.578188    5021 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb5d3803-48f1-4aea-afab-7f55cbd78882-model-cache\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:35:00.791425 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.791384    5021 generic.go:356] "Generic (PLEG): container finished" podID="eb5d3803-48f1-4aea-afab-7f55cbd78882" containerID="b4a3c684539092eea09c49d714865203e78e599dee9d3c4da83e041b01b6cf17" exitCode=0
Nov 03 18:35:00.791594 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.791427    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"
Nov 03 18:35:00.791594 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.791475    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw" event={"ID":"eb5d3803-48f1-4aea-afab-7f55cbd78882","Type":"ContainerDied","Data":"b4a3c684539092eea09c49d714865203e78e599dee9d3c4da83e041b01b6cf17"}
Nov 03 18:35:00.791594 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.791513    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw" event={"ID":"eb5d3803-48f1-4aea-afab-7f55cbd78882","Type":"ContainerDied","Data":"079cb506092f5b8ce198f6aaf82f3660ed48b306bef0ade05e5f35359e95d5c4"}
Nov 03 18:35:00.791594 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.791533    5021 scope.go:122] "RemoveContainer" containerID="b4a3c684539092eea09c49d714865203e78e599dee9d3c4da83e041b01b6cf17"
Nov 03 18:35:00.801783 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.801765    5021 scope.go:122] "RemoveContainer" containerID="b4a3c684539092eea09c49d714865203e78e599dee9d3c4da83e041b01b6cf17"
Nov 03 18:35:00.802042 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:35:00.802021    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4a3c684539092eea09c49d714865203e78e599dee9d3c4da83e041b01b6cf17\": container with ID starting with b4a3c684539092eea09c49d714865203e78e599dee9d3c4da83e041b01b6cf17 not found: ID does not exist" containerID="b4a3c684539092eea09c49d714865203e78e599dee9d3c4da83e041b01b6cf17"
Nov 03 18:35:00.802121 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.802053    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4a3c684539092eea09c49d714865203e78e599dee9d3c4da83e041b01b6cf17"} err="failed to get container status \"b4a3c684539092eea09c49d714865203e78e599dee9d3c4da83e041b01b6cf17\": rpc error: code = NotFound desc = could not find container \"b4a3c684539092eea09c49d714865203e78e599dee9d3c4da83e041b01b6cf17\": container with ID starting with b4a3c684539092eea09c49d714865203e78e599dee9d3c4da83e041b01b6cf17 not found: ID does not exist"
Nov 03 18:35:00.965775 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:00.965742    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"]
Nov 03 18:35:01.018805 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:01.018768    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-57d07b/simulator-single-main-57d07b-kserve-57bfb4d86c-jwwgw"]
Nov 03 18:35:02.003143 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:02.003098    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eb5d3803-48f1-4aea-afab-7f55cbd78882" path="/var/lib/kubelet/pods/eb5d3803-48f1-4aea-afab-7f55cbd78882/volumes"
Nov 03 18:35:07.045479 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:35:07.045442    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:35:37.045818 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:35:37.045738    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:35:50.946250 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:50.943340    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xr7mz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 18:35:50.946250 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:35:50.943438    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 18:36:07.044738 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:36:07.044696    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:36:09.362239 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.362192    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"]
Nov 03 18:36:09.362634 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.362618    5021 cpu_manager.go:414] "containerMap: removing container" podUID="eb5d3803-48f1-4aea-afab-7f55cbd78882" containerName="main"
Nov 03 18:36:09.362634 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.362631    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eb5d3803-48f1-4aea-afab-7f55cbd78882" containerName="main"
Nov 03 18:36:09.362735 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.362724    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="eb5d3803-48f1-4aea-afab-7f55cbd78882" containerName="main"
Nov 03 18:36:09.364677 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.364660    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.422045 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.422009    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"]
Nov 03 18:36:09.471637 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.471602    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-5bcc180a-kserve-self-signed-certs\""
Nov 03 18:36:09.491015 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.490977    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc8vg\" (UniqueName: \"kubernetes.io/projected/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-kube-api-access-bc8vg\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.491157 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.491040    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-dshm\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.491157 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.491122    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-tls-certs\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.491281 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.491161    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-home\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.491281 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.491179    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-tmp-dir\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.491369 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.491290    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-model-cache\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.592613 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.592580    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-model-cache\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.592838 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.592808    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc8vg\" (UniqueName: \"kubernetes.io/projected/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-kube-api-access-bc8vg\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.592911 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.592896    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-dshm\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.592973 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.592928    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-tls-certs\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.592973 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.592966    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-home\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.593076 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.592988    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-tmp-dir\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.593076 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.593027    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-model-cache\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.593386 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.593360    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-home\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.593463 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.593414    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-tmp-dir\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.595255 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.595220    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-dshm\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.595467 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.595452    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-tls-certs\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.663814 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.658943    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc8vg\" (UniqueName: \"kubernetes.io/projected/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-kube-api-access-bc8vg\") pod \"e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") " pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:09.674643 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:09.674615    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:10.052872 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:10.052843    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"]
Nov 03 18:36:10.053280 ip-10-0-137-219 kubenswrapper[5021]: W1103 18:36:10.053256    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b729e9b_31e7_4e30_bd61_834ffdf7ed2e.slice/crio-8a59060aa275895c3191d2a87af368fa4b2d7dead630ced6a841adf835c6cd82 WatchSource:0}: Error finding container 8a59060aa275895c3191d2a87af368fa4b2d7dead630ced6a841adf835c6cd82: Status 404 returned error can't find the container with id 8a59060aa275895c3191d2a87af368fa4b2d7dead630ced6a841adf835c6cd82
Nov 03 18:36:10.207939 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:10.207900    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg" event={"ID":"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e","Type":"ContainerStarted","Data":"274a0566da611ba939104016b3fea2399b160b00ca42d4397688beea152ea72d"}
Nov 03 18:36:10.208127 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:10.207950    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg" event={"ID":"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e","Type":"ContainerStarted","Data":"8a59060aa275895c3191d2a87af368fa4b2d7dead630ced6a841adf835c6cd82"}
Nov 03 18:36:10.332024 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:10.331914    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg" podStartSLOduration=1.331901899 podStartE2EDuration="1.331901899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 18:36:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 18:36:10.331457204 +0000 UTC m=+4770.532795239" watchObservedRunningTime="2026-11-03 18:36:10.331901899 +0000 UTC m=+4770.533239951"
Nov 03 18:36:10.675803 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:10.675723    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:19.674983 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:19.674945    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:19.687527 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:19.687496    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:20.320205 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:20.320178    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:36:37.045583 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:36:37.045534    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:36:40.743607 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:40.743488    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:36:40.748306 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:36:40.748283    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:37:07.045549 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:37:07.045468    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:37:07.738949 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:07.738914    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"]
Nov 03 18:37:15.659879 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:15.659340    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-sz4qn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 18:37:15.659879 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:15.659427    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" podUID="5bacd2fb-f446-4db3-bb86-92a9d923a034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 18:37:22.758857 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:22.758796    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg" podUID="7b729e9b-31e7-4e30-bd61-834ffdf7ed2e" containerName="main" containerID="cri-o://274a0566da611ba939104016b3fea2399b160b00ca42d4397688beea152ea72d" gracePeriod=45
Nov 03 18:37:23.026875 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.026851    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:37:23.138837 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.138797    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-tmp-dir\") pod \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") "
Nov 03 18:37:23.139060 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.138849    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-tls-certs\") pod \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") "
Nov 03 18:37:23.139060 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.138914    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-kube-api-access-bc8vg\" (UniqueName: \"kubernetes.io/projected/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-kube-api-access-bc8vg\") pod \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") "
Nov 03 18:37:23.139060 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.138946    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-model-cache\") pod \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") "
Nov 03 18:37:23.139060 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.139040    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-dshm\") pod \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") "
Nov 03 18:37:23.139337 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.139097    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-home\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-home\") pod \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\" (UID: \"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e\") "
Nov 03 18:37:23.139337 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.139166    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-tmp-dir" pod "7b729e9b-31e7-4e30-bd61-834ffdf7ed2e" (UID: "7b729e9b-31e7-4e30-bd61-834ffdf7ed2e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:37:23.139454 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.139419    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-model-cache" pod "7b729e9b-31e7-4e30-bd61-834ffdf7ed2e" (UID: "7b729e9b-31e7-4e30-bd61-834ffdf7ed2e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:37:23.139593 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.139574    5021 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-model-cache\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:37:23.139668 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.139600    5021 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-tmp-dir\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:37:23.139802 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.139752    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-home" pod "7b729e9b-31e7-4e30-bd61-834ffdf7ed2e" (UID: "7b729e9b-31e7-4e30-bd61-834ffdf7ed2e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:37:23.141284 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.141261    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-tls-certs" pod "7b729e9b-31e7-4e30-bd61-834ffdf7ed2e" (UID: "7b729e9b-31e7-4e30-bd61-834ffdf7ed2e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 18:37:23.141456 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.141440    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-kube-api-access-bc8vg" pod "7b729e9b-31e7-4e30-bd61-834ffdf7ed2e" (UID: "7b729e9b-31e7-4e30-bd61-834ffdf7ed2e"). InnerVolumeSpecName "kube-api-access-bc8vg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:37:23.141570 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.141549    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-dshm" pod "7b729e9b-31e7-4e30-bd61-834ffdf7ed2e" (UID: "7b729e9b-31e7-4e30-bd61-834ffdf7ed2e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 18:37:23.240571 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.240537    5021 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-dshm\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:37:23.240571 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.240564    5021 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-home\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:37:23.240571 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.240574    5021 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-tls-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:37:23.240804 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.240583    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc8vg\" (UniqueName: \"kubernetes.io/projected/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e-kube-api-access-bc8vg\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:37:23.732632 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.732598    5021 generic.go:356] "Generic (PLEG): container finished" podID="7b729e9b-31e7-4e30-bd61-834ffdf7ed2e" containerID="274a0566da611ba939104016b3fea2399b160b00ca42d4397688beea152ea72d" exitCode=0
Nov 03 18:37:23.732820 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.732642    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"
Nov 03 18:37:23.732820 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.732649    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg" event={"ID":"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e","Type":"ContainerDied","Data":"274a0566da611ba939104016b3fea2399b160b00ca42d4397688beea152ea72d"}
Nov 03 18:37:23.732820 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.732679    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg" event={"ID":"7b729e9b-31e7-4e30-bd61-834ffdf7ed2e","Type":"ContainerDied","Data":"8a59060aa275895c3191d2a87af368fa4b2d7dead630ced6a841adf835c6cd82"}
Nov 03 18:37:23.732820 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.732695    5021 scope.go:122] "RemoveContainer" containerID="274a0566da611ba939104016b3fea2399b160b00ca42d4397688beea152ea72d"
Nov 03 18:37:23.742428 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.742407    5021 scope.go:122] "RemoveContainer" containerID="274a0566da611ba939104016b3fea2399b160b00ca42d4397688beea152ea72d"
Nov 03 18:37:23.742687 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:37:23.742668    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"274a0566da611ba939104016b3fea2399b160b00ca42d4397688beea152ea72d\": container with ID starting with 274a0566da611ba939104016b3fea2399b160b00ca42d4397688beea152ea72d not found: ID does not exist" containerID="274a0566da611ba939104016b3fea2399b160b00ca42d4397688beea152ea72d"
Nov 03 18:37:23.742891 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.742699    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"274a0566da611ba939104016b3fea2399b160b00ca42d4397688beea152ea72d"} err="failed to get container status \"274a0566da611ba939104016b3fea2399b160b00ca42d4397688beea152ea72d\": rpc error: code = NotFound desc = could not find container \"274a0566da611ba939104016b3fea2399b160b00ca42d4397688beea152ea72d\": container with ID starting with 274a0566da611ba939104016b3fea2399b160b00ca42d4397688beea152ea72d not found: ID does not exist"
Nov 03 18:37:23.906615 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.906576    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"]
Nov 03 18:37:23.959770 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:23.959737    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-5bcc180a-kserve-7fc99d4649-5dwzg"]
Nov 03 18:37:24.003053 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:24.003027    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b729e9b-31e7-4e30-bd61-834ffdf7ed2e" path="/var/lib/kubelet/pods/7b729e9b-31e7-4e30-bd61-834ffdf7ed2e/volumes"
Nov 03 18:37:35.938411 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:35.938351    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xr7mz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 18:37:35.939090 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:37:35.939055    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 18:37:37.045364 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:37:37.045327    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:38:07.045081 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:38:07.045039    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:38:11.256313 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.256279    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"]
Nov 03 18:38:11.256742 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.256721    5021 cpu_manager.go:414] "containerMap: removing container" podUID="7b729e9b-31e7-4e30-bd61-834ffdf7ed2e" containerName="main"
Nov 03 18:38:11.256742 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.256736    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b729e9b-31e7-4e30-bd61-834ffdf7ed2e" containerName="main"
Nov 03 18:38:11.256894 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.256829    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b729e9b-31e7-4e30-bd61-834ffdf7ed2e" containerName="main"
Nov 03 18:38:11.260117 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.260098    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:38:11.315813 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.315778    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"]
Nov 03 18:38:11.360042 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.360005    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0821a4dc-dc1f-48fa-8e44-fa60d5103181-metrics-certs\") pod \"maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f\" (UID: \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:38:11.360220 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.360046    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0821a4dc-dc1f-48fa-8e44-fa60d5103181-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f\" (UID: \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:38:11.360220 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.360131    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0821a4dc-dc1f-48fa-8e44-fa60d5103181-maas-api-tls\") pod \"maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f\" (UID: \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:38:11.360220 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.360187    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kltq\" (UniqueName: \"kubernetes.io/projected/0821a4dc-dc1f-48fa-8e44-fa60d5103181-kube-api-access-7kltq\") pod \"maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f\" (UID: \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:38:11.366748 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.366724    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-4ee65c-serving-cert\""
Nov 03 18:38:11.461591 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.461555    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0821a4dc-dc1f-48fa-8e44-fa60d5103181-metrics-certs\") pod \"maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f\" (UID: \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:38:11.461764 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.461601    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0821a4dc-dc1f-48fa-8e44-fa60d5103181-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f\" (UID: \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:38:11.461764 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.461643    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0821a4dc-dc1f-48fa-8e44-fa60d5103181-maas-api-tls\") pod \"maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f\" (UID: \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:38:11.461764 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.461663    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kltq\" (UniqueName: \"kubernetes.io/projected/0821a4dc-dc1f-48fa-8e44-fa60d5103181-kube-api-access-7kltq\") pod \"maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f\" (UID: \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:38:11.461883 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:38:11.461789    5021 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-serving-cert: secret "maas-api-e2e-ipp-a-4ee65c-serving-cert" not found
Nov 03 18:38:11.461883 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:38:11.461861    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0821a4dc-dc1f-48fa-8e44-fa60d5103181-maas-api-tls podName:0821a4dc-dc1f-48fa-8e44-fa60d5103181 nodeName:}" failed. No retries permitted until 2026-11-03 18:38:11.961844106 +0000 UTC m=+4892.163182150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0821a4dc-dc1f-48fa-8e44-fa60d5103181-maas-api-tls") pod "maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f" (UID: "0821a4dc-dc1f-48fa-8e44-fa60d5103181") : secret "maas-api-e2e-ipp-a-4ee65c-serving-cert" not found
Nov 03 18:38:11.462379 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.462358    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0821a4dc-dc1f-48fa-8e44-fa60d5103181-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f\" (UID: \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:38:11.464171 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.464148    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0821a4dc-dc1f-48fa-8e44-fa60d5103181-metrics-certs\") pod \"maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f\" (UID: \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:38:11.528864 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.528790    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kltq\" (UniqueName: \"kubernetes.io/projected/0821a4dc-dc1f-48fa-8e44-fa60d5103181-kube-api-access-7kltq\") pod \"maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f\" (UID: \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:38:11.967349 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.967258    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0821a4dc-dc1f-48fa-8e44-fa60d5103181-maas-api-tls\") pod \"maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f\" (UID: \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:38:11.969730 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:11.969701    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0821a4dc-dc1f-48fa-8e44-fa60d5103181-maas-api-tls\") pod \"maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f\" (UID: \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:38:12.173516 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:12.173480    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:38:12.557528 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:12.557501    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"]
Nov 03 18:38:12.558441 ip-10-0-137-219 kubenswrapper[5021]: W1103 18:38:12.558415    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0821a4dc_dc1f_48fa_8e44_fa60d5103181.slice/crio-a463d4c2cd98fdb77e3e4bb7533281dbcadd53a367416bcf2f2996f0767e0ca5 WatchSource:0}: Error finding container a463d4c2cd98fdb77e3e4bb7533281dbcadd53a367416bcf2f2996f0767e0ca5: Status 404 returned error can't find the container with id a463d4c2cd98fdb77e3e4bb7533281dbcadd53a367416bcf2f2996f0767e0ca5
Nov 03 18:38:12.560214 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:12.560196    5021 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 18:38:13.045406 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:13.045369    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f" event={"ID":"0821a4dc-dc1f-48fa-8e44-fa60d5103181","Type":"ContainerStarted","Data":"a463d4c2cd98fdb77e3e4bb7533281dbcadd53a367416bcf2f2996f0767e0ca5"}
Nov 03 18:38:14.051505 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:14.051471    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f" event={"ID":"0821a4dc-dc1f-48fa-8e44-fa60d5103181","Type":"ContainerStarted","Data":"7ea7632374f7c529d04e5adc8b5e8fed097d427562af3c4c4afa3bcff05b8ba5"}
Nov 03 18:38:14.051960 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:14.051602    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:38:14.226656 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:14.226600    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f" podStartSLOduration=2.3325683440000002 podStartE2EDuration="3.226586006s" totalImagesPullingTime="894.017662ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 18:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 18:38:14.22529467 +0000 UTC m=+4894.426632726" watchObservedRunningTime="2026-11-03 18:38:14.226586006 +0000 UTC m=+4894.427924089"
Nov 03 18:38:16.929422 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:16.929388    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"]
Nov 03 18:38:16.933215 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:16.933197    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"
Nov 03 18:38:16.987648 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:16.987616    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"]
Nov 03 18:38:17.018400 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.018365    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fec2d923-d125-424e-bc33-b22af5de3e52-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg\" (UID: \"fec2d923-d125-424e-bc33-b22af5de3e52\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"
Nov 03 18:38:17.018534 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.018411    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krjw6\" (UniqueName: \"kubernetes.io/projected/fec2d923-d125-424e-bc33-b22af5de3e52-kube-api-access-krjw6\") pod \"payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg\" (UID: \"fec2d923-d125-424e-bc33-b22af5de3e52\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"
Nov 03 18:38:17.037894 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.037871    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-4ee65c\""
Nov 03 18:38:17.037989 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.037916    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-4ee65c-dockercfg-ckth8\""
Nov 03 18:38:17.119467 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.119435    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fec2d923-d125-424e-bc33-b22af5de3e52-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg\" (UID: \"fec2d923-d125-424e-bc33-b22af5de3e52\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"
Nov 03 18:38:17.119625 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.119480    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krjw6\" (UniqueName: \"kubernetes.io/projected/fec2d923-d125-424e-bc33-b22af5de3e52-kube-api-access-krjw6\") pod \"payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg\" (UID: \"fec2d923-d125-424e-bc33-b22af5de3e52\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"
Nov 03 18:38:17.120139 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.120119    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fec2d923-d125-424e-bc33-b22af5de3e52-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg\" (UID: \"fec2d923-d125-424e-bc33-b22af5de3e52\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"
Nov 03 18:38:17.183656 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.183595    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krjw6\" (UniqueName: \"kubernetes.io/projected/fec2d923-d125-424e-bc33-b22af5de3e52-kube-api-access-krjw6\") pod \"payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg\" (UID: \"fec2d923-d125-424e-bc33-b22af5de3e52\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"
Nov 03 18:38:17.246798 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.246765    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"
Nov 03 18:38:17.627197 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.627171    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"]
Nov 03 18:38:17.627862 ip-10-0-137-219 kubenswrapper[5021]: W1103 18:38:17.627827    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec2d923_d125_424e_bc33_b22af5de3e52.slice/crio-de11ed080853b39a599b4512701517e4a2d5935be8a65acbf14d178fab1f6e7d WatchSource:0}: Error finding container de11ed080853b39a599b4512701517e4a2d5935be8a65acbf14d178fab1f6e7d: Status 404 returned error can't find the container with id de11ed080853b39a599b4512701517e4a2d5935be8a65acbf14d178fab1f6e7d
Nov 03 18:38:17.718190 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.718158    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"]
Nov 03 18:38:17.723150 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.723128    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"
Nov 03 18:38:17.780680 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.780644    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"]
Nov 03 18:38:17.829679 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.829636    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c69aa69-1246-46fb-b466-4a57fb2805d4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn\" (UID: \"5c69aa69-1246-46fb-b466-4a57fb2805d4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"
Nov 03 18:38:17.829856 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.829755    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l56j\" (UniqueName: \"kubernetes.io/projected/5c69aa69-1246-46fb-b466-4a57fb2805d4-kube-api-access-8l56j\") pod \"payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn\" (UID: \"5c69aa69-1246-46fb-b466-4a57fb2805d4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"
Nov 03 18:38:17.931126 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.931050    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c69aa69-1246-46fb-b466-4a57fb2805d4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn\" (UID: \"5c69aa69-1246-46fb-b466-4a57fb2805d4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"
Nov 03 18:38:17.931126 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.931100    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l56j\" (UniqueName: \"kubernetes.io/projected/5c69aa69-1246-46fb-b466-4a57fb2805d4-kube-api-access-8l56j\") pod \"payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn\" (UID: \"5c69aa69-1246-46fb-b466-4a57fb2805d4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"
Nov 03 18:38:17.931776 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.931756    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c69aa69-1246-46fb-b466-4a57fb2805d4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn\" (UID: \"5c69aa69-1246-46fb-b466-4a57fb2805d4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"
Nov 03 18:38:17.995919 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:17.995883    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l56j\" (UniqueName: \"kubernetes.io/projected/5c69aa69-1246-46fb-b466-4a57fb2805d4-kube-api-access-8l56j\") pod \"payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn\" (UID: \"5c69aa69-1246-46fb-b466-4a57fb2805d4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"
Nov 03 18:38:18.037519 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:18.037488    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"
Nov 03 18:38:18.073808 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:18.073775    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg" event={"ID":"fec2d923-d125-424e-bc33-b22af5de3e52","Type":"ContainerStarted","Data":"de11ed080853b39a599b4512701517e4a2d5935be8a65acbf14d178fab1f6e7d"}
Nov 03 18:38:18.418792 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:18.418750    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"]
Nov 03 18:38:18.419842 ip-10-0-137-219 kubenswrapper[5021]: W1103 18:38:18.419808    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c69aa69_1246_46fb_b466_4a57fb2805d4.slice/crio-0a116d6c579fbe3012b53ad6f390da726ea4d13905c6ea86bdf5c7116cc0841e WatchSource:0}: Error finding container 0a116d6c579fbe3012b53ad6f390da726ea4d13905c6ea86bdf5c7116cc0841e: Status 404 returned error can't find the container with id 0a116d6c579fbe3012b53ad6f390da726ea4d13905c6ea86bdf5c7116cc0841e
Nov 03 18:38:19.079851 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:19.079818    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn" event={"ID":"5c69aa69-1246-46fb-b466-4a57fb2805d4","Type":"ContainerStarted","Data":"0a116d6c579fbe3012b53ad6f390da726ea4d13905c6ea86bdf5c7116cc0841e"}
Nov 03 18:38:20.065049 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:20.064369    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:38:22.099618 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:22.099574    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg" event={"ID":"fec2d923-d125-424e-bc33-b22af5de3e52","Type":"ContainerStarted","Data":"8942a2b7a89018e69dcc8624728125d07a345da63d73a9b6f54792340e2573e3"}
Nov 03 18:38:22.100123 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:22.099654    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"
Nov 03 18:38:22.101356 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:22.101331    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn" event={"ID":"5c69aa69-1246-46fb-b466-4a57fb2805d4","Type":"ContainerStarted","Data":"dfc75b724e1b42ad5003fc2639afe711e0e7d2b4d2412d2a4b0eef95e51c6c95"}
Nov 03 18:38:22.101479 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:22.101376    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"
Nov 03 18:38:22.223478 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:22.223424    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg" podStartSLOduration=2.194175092 podStartE2EDuration="6.22341081s" totalImagesPullingTime="4.029235718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 18:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 18:38:22.222011861 +0000 UTC m=+4902.423349914" watchObservedRunningTime="2026-11-03 18:38:22.22341081 +0000 UTC m=+4902.424748862"
Nov 03 18:38:22.345646 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:22.345581    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn" podStartSLOduration=2.109769542 podStartE2EDuration="5.345561202s" totalImagesPullingTime="3.23579166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 18:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 18:38:22.344596265 +0000 UTC m=+4902.545934316" watchObservedRunningTime="2026-11-03 18:38:22.345561202 +0000 UTC m=+4902.546899259"
Nov 03 18:38:33.108431 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:33.108392    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"
Nov 03 18:38:33.108886 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:33.108472    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"
Nov 03 18:38:37.046082 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:38:37.046041    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:38:54.488221 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:54.488183    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"]
Nov 03 18:38:54.492095 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:54.492078    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:38:54.499368 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:54.499346    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fec151c0-6217-4808-9a26-952c4704ca4a-metrics-certs\") pod \"maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr\" (UID: \"fec151c0-6217-4808-9a26-952c4704ca4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:38:54.499482 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:54.499454    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fec151c0-6217-4808-9a26-952c4704ca4a-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr\" (UID: \"fec151c0-6217-4808-9a26-952c4704ca4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:38:54.499598 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:54.499583    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjwxn\" (UniqueName: \"kubernetes.io/projected/fec151c0-6217-4808-9a26-952c4704ca4a-kube-api-access-zjwxn\") pod \"maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr\" (UID: \"fec151c0-6217-4808-9a26-952c4704ca4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:38:54.499665 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:54.499654    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fec151c0-6217-4808-9a26-952c4704ca4a-maas-api-tls\") pod \"maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr\" (UID: \"fec151c0-6217-4808-9a26-952c4704ca4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:38:54.548305 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:54.548267    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"]
Nov 03 18:38:54.599105 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:54.599073    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-48c17a-serving-cert\""
Nov 03 18:38:54.600470 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:54.600446    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjwxn\" (UniqueName: \"kubernetes.io/projected/fec151c0-6217-4808-9a26-952c4704ca4a-kube-api-access-zjwxn\") pod \"maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr\" (UID: \"fec151c0-6217-4808-9a26-952c4704ca4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:38:54.600540 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:54.600523    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fec151c0-6217-4808-9a26-952c4704ca4a-maas-api-tls\") pod \"maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr\" (UID: \"fec151c0-6217-4808-9a26-952c4704ca4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:38:54.600579 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:54.600557    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fec151c0-6217-4808-9a26-952c4704ca4a-metrics-certs\") pod \"maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr\" (UID: \"fec151c0-6217-4808-9a26-952c4704ca4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:38:54.600626 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:54.600594    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fec151c0-6217-4808-9a26-952c4704ca4a-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr\" (UID: \"fec151c0-6217-4808-9a26-952c4704ca4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:38:54.600685 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:38:54.600660    5021 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-serving-cert: secret "maas-api-e2e-ipp-b-48c17a-serving-cert" not found
Nov 03 18:38:54.600748 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:38:54.600734    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fec151c0-6217-4808-9a26-952c4704ca4a-maas-api-tls podName:fec151c0-6217-4808-9a26-952c4704ca4a nodeName:}" failed. No retries permitted until 2026-11-03 18:38:55.100720132 +0000 UTC m=+4935.302058175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fec151c0-6217-4808-9a26-952c4704ca4a-maas-api-tls") pod "maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr" (UID: "fec151c0-6217-4808-9a26-952c4704ca4a") : secret "maas-api-e2e-ipp-b-48c17a-serving-cert" not found
Nov 03 18:38:54.601366 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:54.601341    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fec151c0-6217-4808-9a26-952c4704ca4a-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr\" (UID: \"fec151c0-6217-4808-9a26-952c4704ca4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:38:54.603082 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:54.603055    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fec151c0-6217-4808-9a26-952c4704ca4a-metrics-certs\") pod \"maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr\" (UID: \"fec151c0-6217-4808-9a26-952c4704ca4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:38:54.667404 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:54.667367    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjwxn\" (UniqueName: \"kubernetes.io/projected/fec151c0-6217-4808-9a26-952c4704ca4a-kube-api-access-zjwxn\") pod \"maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr\" (UID: \"fec151c0-6217-4808-9a26-952c4704ca4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:38:55.105123 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:55.105085    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fec151c0-6217-4808-9a26-952c4704ca4a-maas-api-tls\") pod \"maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr\" (UID: \"fec151c0-6217-4808-9a26-952c4704ca4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:38:55.107488 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:55.107461    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fec151c0-6217-4808-9a26-952c4704ca4a-maas-api-tls\") pod \"maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr\" (UID: \"fec151c0-6217-4808-9a26-952c4704ca4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:38:55.405835 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:55.405750    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:38:55.783687 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:55.783658    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"]
Nov 03 18:38:55.785117 ip-10-0-137-219 kubenswrapper[5021]: W1103 18:38:55.785090    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec151c0_6217_4808_9a26_952c4704ca4a.slice/crio-65379140bba0157d6aaa3f8c77960bf27e56540007f45924a8456e239491a592 WatchSource:0}: Error finding container 65379140bba0157d6aaa3f8c77960bf27e56540007f45924a8456e239491a592: Status 404 returned error can't find the container with id 65379140bba0157d6aaa3f8c77960bf27e56540007f45924a8456e239491a592
Nov 03 18:38:56.281424 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:56.281385    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr" event={"ID":"fec151c0-6217-4808-9a26-952c4704ca4a","Type":"ContainerStarted","Data":"65379140bba0157d6aaa3f8c77960bf27e56540007f45924a8456e239491a592"}
Nov 03 18:38:57.288578 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:57.288540    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr" event={"ID":"fec151c0-6217-4808-9a26-952c4704ca4a","Type":"ContainerStarted","Data":"76136168cf7a3a9685cc71aeaee985543b3f79d0b0dc6e4b26ac2eb216864a68"}
Nov 03 18:38:57.288997 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:57.288736    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:38:57.416035 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:38:57.415977    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr" podStartSLOduration=2.620395337 podStartE2EDuration="3.415962838s" totalImagesPullingTime="795.567501ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 18:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 18:38:57.413402501 +0000 UTC m=+4937.614740553" watchObservedRunningTime="2026-11-03 18:38:57.415962838 +0000 UTC m=+4937.617300887"
Nov 03 18:39:03.298935 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:39:03.298904    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:39:07.047601 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:39:07.047563    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:39:37.046578 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:39:37.046534    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:40:07.046372 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:40:07.046293    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:40:29.648682 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:40:29.648651    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn_5c69aa69-1246-46fb-b466-4a57fb2805d4/payload-processing/0.log"
Nov 03 18:40:37.044929 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:40:37.044888    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:41:07.046732 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:41:07.046693    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:41:28.294816 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.294733    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"]
Nov 03 18:41:28.295349 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.294959    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f" podUID="0821a4dc-dc1f-48fa-8e44-fa60d5103181" containerName="maas-api" containerID="cri-o://7ea7632374f7c529d04e5adc8b5e8fed097d427562af3c4c4afa3bcff05b8ba5" gracePeriod=30
Nov 03 18:41:28.559462 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.559403    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:41:28.663313 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.663278    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0821a4dc-dc1f-48fa-8e44-fa60d5103181-kube-api-access-7kltq\" (UniqueName: \"kubernetes.io/projected/0821a4dc-dc1f-48fa-8e44-fa60d5103181-kube-api-access-7kltq\") pod \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\" (UID: \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\") "
Nov 03 18:41:28.663505 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.663347    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0821a4dc-dc1f-48fa-8e44-fa60d5103181-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0821a4dc-dc1f-48fa-8e44-fa60d5103181-maas-api-tls\") pod \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\" (UID: \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\") "
Nov 03 18:41:28.663505 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.663391    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0821a4dc-dc1f-48fa-8e44-fa60d5103181-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0821a4dc-dc1f-48fa-8e44-fa60d5103181-metrics-certs\") pod \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\" (UID: \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\") "
Nov 03 18:41:28.663505 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.663410    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0821a4dc-dc1f-48fa-8e44-fa60d5103181-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0821a4dc-dc1f-48fa-8e44-fa60d5103181-openshift-service-ca\") pod \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\" (UID: \"0821a4dc-dc1f-48fa-8e44-fa60d5103181\") "
Nov 03 18:41:28.663830 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.663803    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0821a4dc-dc1f-48fa-8e44-fa60d5103181-openshift-service-ca" pod "0821a4dc-dc1f-48fa-8e44-fa60d5103181" (UID: "0821a4dc-dc1f-48fa-8e44-fa60d5103181"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 18:41:28.665491 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.665461    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0821a4dc-dc1f-48fa-8e44-fa60d5103181-kube-api-access-7kltq" pod "0821a4dc-dc1f-48fa-8e44-fa60d5103181" (UID: "0821a4dc-dc1f-48fa-8e44-fa60d5103181"). InnerVolumeSpecName "kube-api-access-7kltq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:41:28.665590 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.665491    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0821a4dc-dc1f-48fa-8e44-fa60d5103181-metrics-certs" pod "0821a4dc-dc1f-48fa-8e44-fa60d5103181" (UID: "0821a4dc-dc1f-48fa-8e44-fa60d5103181"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 18:41:28.665590 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.665537    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0821a4dc-dc1f-48fa-8e44-fa60d5103181-maas-api-tls" pod "0821a4dc-dc1f-48fa-8e44-fa60d5103181" (UID: "0821a4dc-dc1f-48fa-8e44-fa60d5103181"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 18:41:28.764709 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.758613    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"]
Nov 03 18:41:28.764709 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.758955    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn" podUID="5c69aa69-1246-46fb-b466-4a57fb2805d4" containerName="payload-processing" containerID="cri-o://dfc75b724e1b42ad5003fc2639afe711e0e7d2b4d2412d2a4b0eef95e51c6c95" gracePeriod=30
Nov 03 18:41:28.766029 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.765990    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kltq\" (UniqueName: \"kubernetes.io/projected/0821a4dc-dc1f-48fa-8e44-fa60d5103181-kube-api-access-7kltq\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:41:28.766029 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.766030    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0821a4dc-dc1f-48fa-8e44-fa60d5103181-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:41:28.766216 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.766051    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0821a4dc-dc1f-48fa-8e44-fa60d5103181-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:41:28.766216 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.766064    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0821a4dc-dc1f-48fa-8e44-fa60d5103181-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:41:28.814797 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.814733    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"]
Nov 03 18:41:28.814994 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:28.814952    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg" podUID="fec2d923-d125-424e-bc33-b22af5de3e52" containerName="payload-pre-processing" containerID="cri-o://8942a2b7a89018e69dcc8624728125d07a345da63d73a9b6f54792340e2573e3" gracePeriod=30
Nov 03 18:41:29.056882 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.056850    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"
Nov 03 18:41:29.102701 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.102675    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"
Nov 03 18:41:29.114479 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.114447    5021 generic.go:356] "Generic (PLEG): container finished" podID="0821a4dc-dc1f-48fa-8e44-fa60d5103181" containerID="7ea7632374f7c529d04e5adc8b5e8fed097d427562af3c4c4afa3bcff05b8ba5" exitCode=0
Nov 03 18:41:29.114614 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.114502    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"
Nov 03 18:41:29.114614 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.114527    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f" event={"ID":"0821a4dc-dc1f-48fa-8e44-fa60d5103181","Type":"ContainerDied","Data":"7ea7632374f7c529d04e5adc8b5e8fed097d427562af3c4c4afa3bcff05b8ba5"}
Nov 03 18:41:29.114614 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.114579    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f" event={"ID":"0821a4dc-dc1f-48fa-8e44-fa60d5103181","Type":"ContainerDied","Data":"a463d4c2cd98fdb77e3e4bb7533281dbcadd53a367416bcf2f2996f0767e0ca5"}
Nov 03 18:41:29.114614 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.114605    5021 scope.go:122] "RemoveContainer" containerID="7ea7632374f7c529d04e5adc8b5e8fed097d427562af3c4c4afa3bcff05b8ba5"
Nov 03 18:41:29.115824 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.115790    5021 generic.go:356] "Generic (PLEG): container finished" podID="5c69aa69-1246-46fb-b466-4a57fb2805d4" containerID="dfc75b724e1b42ad5003fc2639afe711e0e7d2b4d2412d2a4b0eef95e51c6c95" exitCode=0
Nov 03 18:41:29.115943 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.115874    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"
Nov 03 18:41:29.116012 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.115847    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn" event={"ID":"5c69aa69-1246-46fb-b466-4a57fb2805d4","Type":"ContainerDied","Data":"dfc75b724e1b42ad5003fc2639afe711e0e7d2b4d2412d2a4b0eef95e51c6c95"}
Nov 03 18:41:29.116012 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.116005    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn" event={"ID":"5c69aa69-1246-46fb-b466-4a57fb2805d4","Type":"ContainerDied","Data":"0a116d6c579fbe3012b53ad6f390da726ea4d13905c6ea86bdf5c7116cc0841e"}
Nov 03 18:41:29.117470 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.117451    5021 generic.go:356] "Generic (PLEG): container finished" podID="fec2d923-d125-424e-bc33-b22af5de3e52" containerID="8942a2b7a89018e69dcc8624728125d07a345da63d73a9b6f54792340e2573e3" exitCode=0
Nov 03 18:41:29.117599 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.117486    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg" event={"ID":"fec2d923-d125-424e-bc33-b22af5de3e52","Type":"ContainerDied","Data":"8942a2b7a89018e69dcc8624728125d07a345da63d73a9b6f54792340e2573e3"}
Nov 03 18:41:29.117599 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.117489    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"
Nov 03 18:41:29.117599 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.117515    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg" event={"ID":"fec2d923-d125-424e-bc33-b22af5de3e52","Type":"ContainerDied","Data":"de11ed080853b39a599b4512701517e4a2d5935be8a65acbf14d178fab1f6e7d"}
Nov 03 18:41:29.124977 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.124960    5021 scope.go:122] "RemoveContainer" containerID="7ea7632374f7c529d04e5adc8b5e8fed097d427562af3c4c4afa3bcff05b8ba5"
Nov 03 18:41:29.125251 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:41:29.125219    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ea7632374f7c529d04e5adc8b5e8fed097d427562af3c4c4afa3bcff05b8ba5\": container with ID starting with 7ea7632374f7c529d04e5adc8b5e8fed097d427562af3c4c4afa3bcff05b8ba5 not found: ID does not exist" containerID="7ea7632374f7c529d04e5adc8b5e8fed097d427562af3c4c4afa3bcff05b8ba5"
Nov 03 18:41:29.125326 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.125259    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ea7632374f7c529d04e5adc8b5e8fed097d427562af3c4c4afa3bcff05b8ba5"} err="failed to get container status \"7ea7632374f7c529d04e5adc8b5e8fed097d427562af3c4c4afa3bcff05b8ba5\": rpc error: code = NotFound desc = could not find container \"7ea7632374f7c529d04e5adc8b5e8fed097d427562af3c4c4afa3bcff05b8ba5\": container with ID starting with 7ea7632374f7c529d04e5adc8b5e8fed097d427562af3c4c4afa3bcff05b8ba5 not found: ID does not exist"
Nov 03 18:41:29.125326 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.125276    5021 scope.go:122] "RemoveContainer" containerID="dfc75b724e1b42ad5003fc2639afe711e0e7d2b4d2412d2a4b0eef95e51c6c95"
Nov 03 18:41:29.133456 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.133435    5021 scope.go:122] "RemoveContainer" containerID="dfc75b724e1b42ad5003fc2639afe711e0e7d2b4d2412d2a4b0eef95e51c6c95"
Nov 03 18:41:29.133724 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:41:29.133706    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfc75b724e1b42ad5003fc2639afe711e0e7d2b4d2412d2a4b0eef95e51c6c95\": container with ID starting with dfc75b724e1b42ad5003fc2639afe711e0e7d2b4d2412d2a4b0eef95e51c6c95 not found: ID does not exist" containerID="dfc75b724e1b42ad5003fc2639afe711e0e7d2b4d2412d2a4b0eef95e51c6c95"
Nov 03 18:41:29.133776 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.133732    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfc75b724e1b42ad5003fc2639afe711e0e7d2b4d2412d2a4b0eef95e51c6c95"} err="failed to get container status \"dfc75b724e1b42ad5003fc2639afe711e0e7d2b4d2412d2a4b0eef95e51c6c95\": rpc error: code = NotFound desc = could not find container \"dfc75b724e1b42ad5003fc2639afe711e0e7d2b4d2412d2a4b0eef95e51c6c95\": container with ID starting with dfc75b724e1b42ad5003fc2639afe711e0e7d2b4d2412d2a4b0eef95e51c6c95 not found: ID does not exist"
Nov 03 18:41:29.133776 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.133747    5021 scope.go:122] "RemoveContainer" containerID="8942a2b7a89018e69dcc8624728125d07a345da63d73a9b6f54792340e2573e3"
Nov 03 18:41:29.141988 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.141967    5021 scope.go:122] "RemoveContainer" containerID="8942a2b7a89018e69dcc8624728125d07a345da63d73a9b6f54792340e2573e3"
Nov 03 18:41:29.142269 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:41:29.142239    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8942a2b7a89018e69dcc8624728125d07a345da63d73a9b6f54792340e2573e3\": container with ID starting with 8942a2b7a89018e69dcc8624728125d07a345da63d73a9b6f54792340e2573e3 not found: ID does not exist" containerID="8942a2b7a89018e69dcc8624728125d07a345da63d73a9b6f54792340e2573e3"
Nov 03 18:41:29.142334 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.142276    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8942a2b7a89018e69dcc8624728125d07a345da63d73a9b6f54792340e2573e3"} err="failed to get container status \"8942a2b7a89018e69dcc8624728125d07a345da63d73a9b6f54792340e2573e3\": rpc error: code = NotFound desc = could not find container \"8942a2b7a89018e69dcc8624728125d07a345da63d73a9b6f54792340e2573e3\": container with ID starting with 8942a2b7a89018e69dcc8624728125d07a345da63d73a9b6f54792340e2573e3 not found: ID does not exist"
Nov 03 18:41:29.170920 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.170886    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c69aa69-1246-46fb-b466-4a57fb2805d4-kube-api-access-8l56j\" (UniqueName: \"kubernetes.io/projected/5c69aa69-1246-46fb-b466-4a57fb2805d4-kube-api-access-8l56j\") pod \"5c69aa69-1246-46fb-b466-4a57fb2805d4\" (UID: \"5c69aa69-1246-46fb-b466-4a57fb2805d4\") "
Nov 03 18:41:29.171069 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.170998    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5c69aa69-1246-46fb-b466-4a57fb2805d4-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c69aa69-1246-46fb-b466-4a57fb2805d4-plugins-config-volume\") pod \"5c69aa69-1246-46fb-b466-4a57fb2805d4\" (UID: \"5c69aa69-1246-46fb-b466-4a57fb2805d4\") "
Nov 03 18:41:29.171391 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.171363    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c69aa69-1246-46fb-b466-4a57fb2805d4-plugins-config-volume" pod "5c69aa69-1246-46fb-b466-4a57fb2805d4" (UID: "5c69aa69-1246-46fb-b466-4a57fb2805d4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 18:41:29.172965 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.172946    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c69aa69-1246-46fb-b466-4a57fb2805d4-kube-api-access-8l56j" pod "5c69aa69-1246-46fb-b466-4a57fb2805d4" (UID: "5c69aa69-1246-46fb-b466-4a57fb2805d4"). InnerVolumeSpecName "kube-api-access-8l56j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:41:29.272411 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.272372    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fec2d923-d125-424e-bc33-b22af5de3e52-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fec2d923-d125-424e-bc33-b22af5de3e52-plugins-config-volume\") pod \"fec2d923-d125-424e-bc33-b22af5de3e52\" (UID: \"fec2d923-d125-424e-bc33-b22af5de3e52\") "
Nov 03 18:41:29.272646 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.272462    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fec2d923-d125-424e-bc33-b22af5de3e52-kube-api-access-krjw6\" (UniqueName: \"kubernetes.io/projected/fec2d923-d125-424e-bc33-b22af5de3e52-kube-api-access-krjw6\") pod \"fec2d923-d125-424e-bc33-b22af5de3e52\" (UID: \"fec2d923-d125-424e-bc33-b22af5de3e52\") "
Nov 03 18:41:29.273164 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.272766    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fec2d923-d125-424e-bc33-b22af5de3e52-plugins-config-volume" pod "fec2d923-d125-424e-bc33-b22af5de3e52" (UID: "fec2d923-d125-424e-bc33-b22af5de3e52"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 18:41:29.273164 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.272831    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8l56j\" (UniqueName: \"kubernetes.io/projected/5c69aa69-1246-46fb-b466-4a57fb2805d4-kube-api-access-8l56j\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:41:29.273164 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.272851    5021 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c69aa69-1246-46fb-b466-4a57fb2805d4-plugins-config-volume\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:41:29.275527 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.275492    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fec2d923-d125-424e-bc33-b22af5de3e52-kube-api-access-krjw6" pod "fec2d923-d125-424e-bc33-b22af5de3e52" (UID: "fec2d923-d125-424e-bc33-b22af5de3e52"). InnerVolumeSpecName "kube-api-access-krjw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:41:29.345905 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.345831    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"]
Nov 03 18:41:29.351391 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.351361    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4ee65c-6dcf69bc89-qx52f"]
Nov 03 18:41:29.373720 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.373694    5021 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fec2d923-d125-424e-bc33-b22af5de3e52-plugins-config-volume\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:41:29.373720 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.373717    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krjw6\" (UniqueName: \"kubernetes.io/projected/fec2d923-d125-424e-bc33-b22af5de3e52-kube-api-access-krjw6\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:41:29.686116 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.686035    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"]
Nov 03 18:41:29.689601 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.689573    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-4ee65c-66fb785578-b9pvn"]
Nov 03 18:41:29.802207 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.802173    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"]
Nov 03 18:41:29.805984 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:29.805954    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4ee65c-848b6c48bc-7p9lg"]
Nov 03 18:41:30.001903 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:30.001878    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0821a4dc-dc1f-48fa-8e44-fa60d5103181" path="/var/lib/kubelet/pods/0821a4dc-dc1f-48fa-8e44-fa60d5103181/volumes"
Nov 03 18:41:30.002277 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:30.002263    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5c69aa69-1246-46fb-b466-4a57fb2805d4" path="/var/lib/kubelet/pods/5c69aa69-1246-46fb-b466-4a57fb2805d4/volumes"
Nov 03 18:41:30.002605 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:30.002592    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fec2d923-d125-424e-bc33-b22af5de3e52" path="/var/lib/kubelet/pods/fec2d923-d125-424e-bc33-b22af5de3e52/volumes"
Nov 03 18:41:37.045390 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:41:37.045353    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:41:40.785159 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:40.785126    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:41:40.792541 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:40.792519    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:41:54.035679 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:54.035644    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"]
Nov 03 18:41:54.036159 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:54.035838    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr" podUID="fec151c0-6217-4808-9a26-952c4704ca4a" containerName="maas-api" containerID="cri-o://76136168cf7a3a9685cc71aeaee985543b3f79d0b0dc6e4b26ac2eb216864a68" gracePeriod=30
Nov 03 18:41:54.256851 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:54.256818    5021 generic.go:356] "Generic (PLEG): container finished" podID="fec151c0-6217-4808-9a26-952c4704ca4a" containerID="76136168cf7a3a9685cc71aeaee985543b3f79d0b0dc6e4b26ac2eb216864a68" exitCode=0
Nov 03 18:41:54.257031 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:54.256889    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr" event={"ID":"fec151c0-6217-4808-9a26-952c4704ca4a","Type":"ContainerDied","Data":"76136168cf7a3a9685cc71aeaee985543b3f79d0b0dc6e4b26ac2eb216864a68"}
Nov 03 18:41:54.298549 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:54.298486    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:41:54.416237 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:54.416206    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fec151c0-6217-4808-9a26-952c4704ca4a-kube-api-access-zjwxn\" (UniqueName: \"kubernetes.io/projected/fec151c0-6217-4808-9a26-952c4704ca4a-kube-api-access-zjwxn\") pod \"fec151c0-6217-4808-9a26-952c4704ca4a\" (UID: \"fec151c0-6217-4808-9a26-952c4704ca4a\") "
Nov 03 18:41:54.416420 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:54.416298    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fec151c0-6217-4808-9a26-952c4704ca4a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fec151c0-6217-4808-9a26-952c4704ca4a-maas-api-tls\") pod \"fec151c0-6217-4808-9a26-952c4704ca4a\" (UID: \"fec151c0-6217-4808-9a26-952c4704ca4a\") "
Nov 03 18:41:54.416484 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:54.416462    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fec151c0-6217-4808-9a26-952c4704ca4a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fec151c0-6217-4808-9a26-952c4704ca4a-openshift-service-ca\") pod \"fec151c0-6217-4808-9a26-952c4704ca4a\" (UID: \"fec151c0-6217-4808-9a26-952c4704ca4a\") "
Nov 03 18:41:54.416524 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:54.416512    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fec151c0-6217-4808-9a26-952c4704ca4a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/fec151c0-6217-4808-9a26-952c4704ca4a-metrics-certs\") pod \"fec151c0-6217-4808-9a26-952c4704ca4a\" (UID: \"fec151c0-6217-4808-9a26-952c4704ca4a\") "
Nov 03 18:41:54.416898 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:54.416835    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fec151c0-6217-4808-9a26-952c4704ca4a-openshift-service-ca" pod "fec151c0-6217-4808-9a26-952c4704ca4a" (UID: "fec151c0-6217-4808-9a26-952c4704ca4a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 18:41:54.419032 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:54.419005    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec151c0-6217-4808-9a26-952c4704ca4a-metrics-certs" pod "fec151c0-6217-4808-9a26-952c4704ca4a" (UID: "fec151c0-6217-4808-9a26-952c4704ca4a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 18:41:54.419166 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:54.419110    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec151c0-6217-4808-9a26-952c4704ca4a-maas-api-tls" pod "fec151c0-6217-4808-9a26-952c4704ca4a" (UID: "fec151c0-6217-4808-9a26-952c4704ca4a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 18:41:54.419166 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:54.419136    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fec151c0-6217-4808-9a26-952c4704ca4a-kube-api-access-zjwxn" pod "fec151c0-6217-4808-9a26-952c4704ca4a" (UID: "fec151c0-6217-4808-9a26-952c4704ca4a"). InnerVolumeSpecName "kube-api-access-zjwxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:41:54.517676 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:54.517639    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fec151c0-6217-4808-9a26-952c4704ca4a-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:41:54.517676 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:54.517671    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fec151c0-6217-4808-9a26-952c4704ca4a-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:41:54.517676 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:54.517681    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fec151c0-6217-4808-9a26-952c4704ca4a-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:41:54.517924 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:54.517690    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjwxn\" (UniqueName: \"kubernetes.io/projected/fec151c0-6217-4808-9a26-952c4704ca4a-kube-api-access-zjwxn\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:41:55.263952 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:55.263898    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"
Nov 03 18:41:55.263952 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:55.263923    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr" event={"ID":"fec151c0-6217-4808-9a26-952c4704ca4a","Type":"ContainerDied","Data":"65379140bba0157d6aaa3f8c77960bf27e56540007f45924a8456e239491a592"}
Nov 03 18:41:55.264553 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:55.264001    5021 scope.go:122] "RemoveContainer" containerID="76136168cf7a3a9685cc71aeaee985543b3f79d0b0dc6e4b26ac2eb216864a68"
Nov 03 18:41:55.434385 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:55.434347    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"]
Nov 03 18:41:55.445159 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:55.442476    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-48c17a-845f58c858-gxrkr"]
Nov 03 18:41:56.002441 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:41:56.002402    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fec151c0-6217-4808-9a26-952c4704ca4a" path="/var/lib/kubelet/pods/fec151c0-6217-4808-9a26-952c4704ca4a/volumes"
Nov 03 18:42:07.045193 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:42:07.045154    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:42:37.045087 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:42:37.045042    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:43:07.045418 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:43:07.045335    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:43:37.045946 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:43:37.045904    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:44:07.046417 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:44:07.046376    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:44:30.658427 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:44:30.658327    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-sz4qn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 18:44:30.659319 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:44:30.659280    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" podUID="5bacd2fb-f446-4db3-bb86-92a9d923a034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 18:44:37.044449 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:44:37.044407    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:45:07.045613 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:45:07.045574    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:45:37.045144 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:45:37.045105    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:45:46.954254 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:45:46.953388    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xhtvr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 18:45:46.954254 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:45:46.953493    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr" podUID="72ef520b-730f-45ee-a9cf-08513d927905" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 18:46:07.045250 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:46:07.045201    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:46:35.939252 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:46:35.936328    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xr7mz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 18:46:35.939252 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:46:35.936410    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 18:46:37.045580 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:46:37.045542    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:46:40.821444 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:46:40.821331    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:46:40.830337 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:46:40.830315    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:47:07.044918 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:47:07.044879    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:47:31.937421 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:47:31.937326    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xhtvr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 18:47:31.938142 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:47:31.938105    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr" podUID="72ef520b-730f-45ee-a9cf-08513d927905" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 18:47:37.045529 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:47:37.045484    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:47:50.930432 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:47:50.930388    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xr7mz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 18:47:50.931200 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:47:50.931164    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 18:48:07.044447 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:48:07.044402    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:48:16.930252 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:48:16.928367    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xhtvr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 18:48:16.930252 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:48:16.928444    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr" podUID="72ef520b-730f-45ee-a9cf-08513d927905" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 18:48:37.044812 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:48:37.044775    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:49:07.045569 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:49:07.045484    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:49:37.045716 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:49:37.045676    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:50:00.026154 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.026115    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"]
Nov 03 18:50:00.026772 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.026750    5021 cpu_manager.go:414] "containerMap: removing container" podUID="5c69aa69-1246-46fb-b466-4a57fb2805d4" containerName="payload-processing"
Nov 03 18:50:00.026869 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.026774    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c69aa69-1246-46fb-b466-4a57fb2805d4" containerName="payload-processing"
Nov 03 18:50:00.026869 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.026810    5021 cpu_manager.go:414] "containerMap: removing container" podUID="0821a4dc-dc1f-48fa-8e44-fa60d5103181" containerName="maas-api"
Nov 03 18:50:00.026869 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.026818    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0821a4dc-dc1f-48fa-8e44-fa60d5103181" containerName="maas-api"
Nov 03 18:50:00.026869 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.026829    5021 cpu_manager.go:414] "containerMap: removing container" podUID="fec2d923-d125-424e-bc33-b22af5de3e52" containerName="payload-pre-processing"
Nov 03 18:50:00.026869 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.026837    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fec2d923-d125-424e-bc33-b22af5de3e52" containerName="payload-pre-processing"
Nov 03 18:50:00.026869 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.026858    5021 cpu_manager.go:414] "containerMap: removing container" podUID="fec151c0-6217-4808-9a26-952c4704ca4a" containerName="maas-api"
Nov 03 18:50:00.026869 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.026865    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fec151c0-6217-4808-9a26-952c4704ca4a" containerName="maas-api"
Nov 03 18:50:00.027204 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.026980    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="0821a4dc-dc1f-48fa-8e44-fa60d5103181" containerName="maas-api"
Nov 03 18:50:00.027204 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.026993    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="fec2d923-d125-424e-bc33-b22af5de3e52" containerName="payload-pre-processing"
Nov 03 18:50:00.027204 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.027010    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c69aa69-1246-46fb-b466-4a57fb2805d4" containerName="payload-processing"
Nov 03 18:50:00.027204 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.027018    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="fec151c0-6217-4808-9a26-952c4704ca4a" containerName="maas-api"
Nov 03 18:50:00.029513 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.029491    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:50:00.087029 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.087004    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-27a21b-serving-cert\""
Nov 03 18:50:00.131799 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.131768    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce8c2377-a80e-46df-a363-eeccb9782d13-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj\" (UID: \"ce8c2377-a80e-46df-a363-eeccb9782d13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:50:00.131961 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.131807    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5lb4\" (UniqueName: \"kubernetes.io/projected/ce8c2377-a80e-46df-a363-eeccb9782d13-kube-api-access-h5lb4\") pod \"maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj\" (UID: \"ce8c2377-a80e-46df-a363-eeccb9782d13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:50:00.131961 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.131945    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce8c2377-a80e-46df-a363-eeccb9782d13-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj\" (UID: \"ce8c2377-a80e-46df-a363-eeccb9782d13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:50:00.132053 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.132040    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce8c2377-a80e-46df-a363-eeccb9782d13-metrics-certs\") pod \"maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj\" (UID: \"ce8c2377-a80e-46df-a363-eeccb9782d13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:50:00.138166 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.138144    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"]
Nov 03 18:50:00.232792 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.232756    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce8c2377-a80e-46df-a363-eeccb9782d13-metrics-certs\") pod \"maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj\" (UID: \"ce8c2377-a80e-46df-a363-eeccb9782d13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:50:00.232959 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.232807    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce8c2377-a80e-46df-a363-eeccb9782d13-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj\" (UID: \"ce8c2377-a80e-46df-a363-eeccb9782d13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:50:00.232959 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.232844    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5lb4\" (UniqueName: \"kubernetes.io/projected/ce8c2377-a80e-46df-a363-eeccb9782d13-kube-api-access-h5lb4\") pod \"maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj\" (UID: \"ce8c2377-a80e-46df-a363-eeccb9782d13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:50:00.232959 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.232936    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce8c2377-a80e-46df-a363-eeccb9782d13-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj\" (UID: \"ce8c2377-a80e-46df-a363-eeccb9782d13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:50:00.233134 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:50:00.233100    5021 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-serving-cert: secret "maas-api-e2e-worker-single-main-27a21b-serving-cert" not found
Nov 03 18:50:00.233187 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:50:00.233180    5021 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce8c2377-a80e-46df-a363-eeccb9782d13-maas-api-tls podName:ce8c2377-a80e-46df-a363-eeccb9782d13 nodeName:}" failed. No retries permitted until 2026-11-03 18:50:00.733157499 +0000 UTC m=+5600.934495546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ce8c2377-a80e-46df-a363-eeccb9782d13-maas-api-tls") pod "maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj" (UID: "ce8c2377-a80e-46df-a363-eeccb9782d13") : secret "maas-api-e2e-worker-single-main-27a21b-serving-cert" not found
Nov 03 18:50:00.233524 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.233505    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce8c2377-a80e-46df-a363-eeccb9782d13-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj\" (UID: \"ce8c2377-a80e-46df-a363-eeccb9782d13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:50:00.235361 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.235338    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce8c2377-a80e-46df-a363-eeccb9782d13-metrics-certs\") pod \"maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj\" (UID: \"ce8c2377-a80e-46df-a363-eeccb9782d13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:50:00.296703 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.296638    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5lb4\" (UniqueName: \"kubernetes.io/projected/ce8c2377-a80e-46df-a363-eeccb9782d13-kube-api-access-h5lb4\") pod \"maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj\" (UID: \"ce8c2377-a80e-46df-a363-eeccb9782d13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:50:00.738503 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.738419    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce8c2377-a80e-46df-a363-eeccb9782d13-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj\" (UID: \"ce8c2377-a80e-46df-a363-eeccb9782d13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:50:00.740952 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.740926    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce8c2377-a80e-46df-a363-eeccb9782d13-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj\" (UID: \"ce8c2377-a80e-46df-a363-eeccb9782d13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:50:00.941169 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:00.941130    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:50:01.317573 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:01.317512    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"]
Nov 03 18:50:01.319962 ip-10-0-137-219 kubenswrapper[5021]: W1103 18:50:01.319934    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce8c2377_a80e_46df_a363_eeccb9782d13.slice/crio-bace98575027cf7be2cf153f20454821483683d206f5e74989907cc33a0a56cd WatchSource:0}: Error finding container bace98575027cf7be2cf153f20454821483683d206f5e74989907cc33a0a56cd: Status 404 returned error can't find the container with id bace98575027cf7be2cf153f20454821483683d206f5e74989907cc33a0a56cd
Nov 03 18:50:01.321430 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:01.321409    5021 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 18:50:02.182791 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:02.182752    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj" event={"ID":"ce8c2377-a80e-46df-a363-eeccb9782d13","Type":"ContainerStarted","Data":"bace98575027cf7be2cf153f20454821483683d206f5e74989907cc33a0a56cd"}
Nov 03 18:50:03.189298 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:03.189258    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj" event={"ID":"ce8c2377-a80e-46df-a363-eeccb9782d13","Type":"ContainerStarted","Data":"c9306f00eb8d973740ddd557da6a70808a992645e7a08c9ff3475db6442792a4"}
Nov 03 18:50:03.189721 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:03.189338    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:50:03.314988 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:03.314923    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj" podStartSLOduration=3.402734055 podStartE2EDuration="4.314902695s" totalImagesPullingTime="912.16864ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 18:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 18:50:03.311377321 +0000 UTC m=+5603.512715401" watchObservedRunningTime="2026-11-03 18:50:03.314902695 +0000 UTC m=+5603.516240753"
Nov 03 18:50:07.046143 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:50:07.046096    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:50:09.200401 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:50:09.200369    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:50:37.045872 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:50:37.045794    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:51:07.045509 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:51:07.045465    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:51:29.386013 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:29.385966    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"]
Nov 03 18:51:29.386696 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:29.386325    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj" podUID="ce8c2377-a80e-46df-a363-eeccb9782d13" containerName="maas-api" containerID="cri-o://c9306f00eb8d973740ddd557da6a70808a992645e7a08c9ff3475db6442792a4" gracePeriod=30
Nov 03 18:51:30.634878 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.634852    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:51:30.714838 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.714756    5021 generic.go:356] "Generic (PLEG): container finished" podID="ce8c2377-a80e-46df-a363-eeccb9782d13" containerID="c9306f00eb8d973740ddd557da6a70808a992645e7a08c9ff3475db6442792a4" exitCode=0
Nov 03 18:51:30.714838 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.714800    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"
Nov 03 18:51:30.715070 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.714804    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj" event={"ID":"ce8c2377-a80e-46df-a363-eeccb9782d13","Type":"ContainerDied","Data":"c9306f00eb8d973740ddd557da6a70808a992645e7a08c9ff3475db6442792a4"}
Nov 03 18:51:30.715070 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.714945    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj" event={"ID":"ce8c2377-a80e-46df-a363-eeccb9782d13","Type":"ContainerDied","Data":"bace98575027cf7be2cf153f20454821483683d206f5e74989907cc33a0a56cd"}
Nov 03 18:51:30.715070 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.714985    5021 scope.go:122] "RemoveContainer" containerID="c9306f00eb8d973740ddd557da6a70808a992645e7a08c9ff3475db6442792a4"
Nov 03 18:51:30.726688 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.726663    5021 scope.go:122] "RemoveContainer" containerID="c9306f00eb8d973740ddd557da6a70808a992645e7a08c9ff3475db6442792a4"
Nov 03 18:51:30.727446 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:51:30.727419    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9306f00eb8d973740ddd557da6a70808a992645e7a08c9ff3475db6442792a4\": container with ID starting with c9306f00eb8d973740ddd557da6a70808a992645e7a08c9ff3475db6442792a4 not found: ID does not exist" containerID="c9306f00eb8d973740ddd557da6a70808a992645e7a08c9ff3475db6442792a4"
Nov 03 18:51:30.727561 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.727459    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9306f00eb8d973740ddd557da6a70808a992645e7a08c9ff3475db6442792a4"} err="failed to get container status \"c9306f00eb8d973740ddd557da6a70808a992645e7a08c9ff3475db6442792a4\": rpc error: code = NotFound desc = could not find container \"c9306f00eb8d973740ddd557da6a70808a992645e7a08c9ff3475db6442792a4\": container with ID starting with c9306f00eb8d973740ddd557da6a70808a992645e7a08c9ff3475db6442792a4 not found: ID does not exist"
Nov 03 18:51:30.743154 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.743133    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ce8c2377-a80e-46df-a363-eeccb9782d13-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce8c2377-a80e-46df-a363-eeccb9782d13-openshift-service-ca\") pod \"ce8c2377-a80e-46df-a363-eeccb9782d13\" (UID: \"ce8c2377-a80e-46df-a363-eeccb9782d13\") "
Nov 03 18:51:30.743297 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.743198    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ce8c2377-a80e-46df-a363-eeccb9782d13-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce8c2377-a80e-46df-a363-eeccb9782d13-metrics-certs\") pod \"ce8c2377-a80e-46df-a363-eeccb9782d13\" (UID: \"ce8c2377-a80e-46df-a363-eeccb9782d13\") "
Nov 03 18:51:30.743297 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.743252    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce8c2377-a80e-46df-a363-eeccb9782d13-kube-api-access-h5lb4\" (UniqueName: \"kubernetes.io/projected/ce8c2377-a80e-46df-a363-eeccb9782d13-kube-api-access-h5lb4\") pod \"ce8c2377-a80e-46df-a363-eeccb9782d13\" (UID: \"ce8c2377-a80e-46df-a363-eeccb9782d13\") "
Nov 03 18:51:30.743420 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.743331    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ce8c2377-a80e-46df-a363-eeccb9782d13-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce8c2377-a80e-46df-a363-eeccb9782d13-maas-api-tls\") pod \"ce8c2377-a80e-46df-a363-eeccb9782d13\" (UID: \"ce8c2377-a80e-46df-a363-eeccb9782d13\") "
Nov 03 18:51:30.743585 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.743562    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce8c2377-a80e-46df-a363-eeccb9782d13-openshift-service-ca" pod "ce8c2377-a80e-46df-a363-eeccb9782d13" (UID: "ce8c2377-a80e-46df-a363-eeccb9782d13"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 18:51:30.743844 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.743821    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce8c2377-a80e-46df-a363-eeccb9782d13-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:51:30.745463 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.745444    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce8c2377-a80e-46df-a363-eeccb9782d13-metrics-certs" pod "ce8c2377-a80e-46df-a363-eeccb9782d13" (UID: "ce8c2377-a80e-46df-a363-eeccb9782d13"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 18:51:30.745563 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.745493    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce8c2377-a80e-46df-a363-eeccb9782d13-kube-api-access-h5lb4" pod "ce8c2377-a80e-46df-a363-eeccb9782d13" (UID: "ce8c2377-a80e-46df-a363-eeccb9782d13"). InnerVolumeSpecName "kube-api-access-h5lb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:51:30.745563 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.745517    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce8c2377-a80e-46df-a363-eeccb9782d13-maas-api-tls" pod "ce8c2377-a80e-46df-a363-eeccb9782d13" (UID: "ce8c2377-a80e-46df-a363-eeccb9782d13"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 18:51:30.845301 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.845259    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce8c2377-a80e-46df-a363-eeccb9782d13-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:51:30.845301 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.845298    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce8c2377-a80e-46df-a363-eeccb9782d13-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:51:30.845301 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:30.845311    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5lb4\" (UniqueName: \"kubernetes.io/projected/ce8c2377-a80e-46df-a363-eeccb9782d13-kube-api-access-h5lb4\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:51:31.140021 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:31.139985    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"]
Nov 03 18:51:31.143535 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:31.143509    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-27a21b-59f8f78b66-lz8wj"]
Nov 03 18:51:32.002810 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:32.002778    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ce8c2377-a80e-46df-a363-eeccb9782d13" path="/var/lib/kubelet/pods/ce8c2377-a80e-46df-a363-eeccb9782d13/volumes"
Nov 03 18:51:37.045053 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:51:37.045020    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:51:40.859721 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:40.859612    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:51:40.868354 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:51:40.868334    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:52:07.048368 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:52:07.048281    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:52:20.935598 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:52:20.935552    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xr7mz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 18:52:20.936356 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:52:20.936318    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 18:52:37.045375 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:52:37.045335    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:53:07.045723 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:53:07.045680    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:53:37.044950 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:53:37.044872    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:54:07.045799 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:54:07.045764    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:54:15.617817 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:15.617772    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-sz4qn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 18:54:15.618340 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:15.617846    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" podUID="5bacd2fb-f446-4db3-bb86-92a9d923a034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 18:54:27.259449 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.259409    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-669c98d779-np82t"]
Nov 03 18:54:27.260113 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.260091    5021 cpu_manager.go:414] "containerMap: removing container" podUID="ce8c2377-a80e-46df-a363-eeccb9782d13" containerName="maas-api"
Nov 03 18:54:27.260209 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.260116    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce8c2377-a80e-46df-a363-eeccb9782d13" containerName="maas-api"
Nov 03 18:54:27.260309 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.260295    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce8c2377-a80e-46df-a363-eeccb9782d13" containerName="maas-api"
Nov 03 18:54:27.263764 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.263741    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t"
Nov 03 18:54:27.289572 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.289534    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a598e016-3fb9-494c-aa41-cb88d6125691-maas-api-tls\") pod \"maas-api-669c98d779-np82t\" (UID: \"a598e016-3fb9-494c-aa41-cb88d6125691\") " pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t"
Nov 03 18:54:27.289721 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.289580    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a598e016-3fb9-494c-aa41-cb88d6125691-openshift-service-ca\") pod \"maas-api-669c98d779-np82t\" (UID: \"a598e016-3fb9-494c-aa41-cb88d6125691\") " pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t"
Nov 03 18:54:27.289721 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.289620    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42tqr\" (UniqueName: \"kubernetes.io/projected/a598e016-3fb9-494c-aa41-cb88d6125691-kube-api-access-42tqr\") pod \"maas-api-669c98d779-np82t\" (UID: \"a598e016-3fb9-494c-aa41-cb88d6125691\") " pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t"
Nov 03 18:54:27.289721 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.289643    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a598e016-3fb9-494c-aa41-cb88d6125691-metrics-certs\") pod \"maas-api-669c98d779-np82t\" (UID: \"a598e016-3fb9-494c-aa41-cb88d6125691\") " pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t"
Nov 03 18:54:27.372326 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.372287    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-669c98d779-np82t"]
Nov 03 18:54:27.390323 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.390291    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a598e016-3fb9-494c-aa41-cb88d6125691-maas-api-tls\") pod \"maas-api-669c98d779-np82t\" (UID: \"a598e016-3fb9-494c-aa41-cb88d6125691\") " pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t"
Nov 03 18:54:27.390480 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.390336    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a598e016-3fb9-494c-aa41-cb88d6125691-openshift-service-ca\") pod \"maas-api-669c98d779-np82t\" (UID: \"a598e016-3fb9-494c-aa41-cb88d6125691\") " pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t"
Nov 03 18:54:27.390480 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.390385    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42tqr\" (UniqueName: \"kubernetes.io/projected/a598e016-3fb9-494c-aa41-cb88d6125691-kube-api-access-42tqr\") pod \"maas-api-669c98d779-np82t\" (UID: \"a598e016-3fb9-494c-aa41-cb88d6125691\") " pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t"
Nov 03 18:54:27.390480 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.390414    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a598e016-3fb9-494c-aa41-cb88d6125691-metrics-certs\") pod \"maas-api-669c98d779-np82t\" (UID: \"a598e016-3fb9-494c-aa41-cb88d6125691\") " pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t"
Nov 03 18:54:27.391129 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.391106    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a598e016-3fb9-494c-aa41-cb88d6125691-openshift-service-ca\") pod \"maas-api-669c98d779-np82t\" (UID: \"a598e016-3fb9-494c-aa41-cb88d6125691\") " pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t"
Nov 03 18:54:27.392856 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.392835    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a598e016-3fb9-494c-aa41-cb88d6125691-maas-api-tls\") pod \"maas-api-669c98d779-np82t\" (UID: \"a598e016-3fb9-494c-aa41-cb88d6125691\") " pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t"
Nov 03 18:54:27.392997 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.392883    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a598e016-3fb9-494c-aa41-cb88d6125691-metrics-certs\") pod \"maas-api-669c98d779-np82t\" (UID: \"a598e016-3fb9-494c-aa41-cb88d6125691\") " pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t"
Nov 03 18:54:27.453533 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.453498    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42tqr\" (UniqueName: \"kubernetes.io/projected/a598e016-3fb9-494c-aa41-cb88d6125691-kube-api-access-42tqr\") pod \"maas-api-669c98d779-np82t\" (UID: \"a598e016-3fb9-494c-aa41-cb88d6125691\") " pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t"
Nov 03 18:54:27.577781 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.577695    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t"
Nov 03 18:54:27.954195 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:27.954167    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-669c98d779-np82t"]
Nov 03 18:54:27.956592 ip-10-0-137-219 kubenswrapper[5021]: W1103 18:54:27.956562    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda598e016_3fb9_494c_aa41_cb88d6125691.slice/crio-4ac262f488f8ecc4acbb5295ececbbf03caf49648bf3e9c1fbf017feca580629 WatchSource:0}: Error finding container 4ac262f488f8ecc4acbb5295ececbbf03caf49648bf3e9c1fbf017feca580629: Status 404 returned error can't find the container with id 4ac262f488f8ecc4acbb5295ececbbf03caf49648bf3e9c1fbf017feca580629
Nov 03 18:54:28.753584 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:28.753547    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t" event={"ID":"a598e016-3fb9-494c-aa41-cb88d6125691","Type":"ContainerStarted","Data":"4ac262f488f8ecc4acbb5295ececbbf03caf49648bf3e9c1fbf017feca580629"}
Nov 03 18:54:29.761201 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:29.761166    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t" event={"ID":"a598e016-3fb9-494c-aa41-cb88d6125691","Type":"ContainerStarted","Data":"ebf7d24b0e5b23539612b0d3d69485f39dfbce501ff5c34ca92ed5fcec29639a"}
Nov 03 18:54:29.761630 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:29.761374    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t"
Nov 03 18:54:29.882884 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:29.882827    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t" podStartSLOduration=2.024451011 podStartE2EDuration="2.88281488s" totalImagesPullingTime="858.363869ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 18:54:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 18:54:29.882281162 +0000 UTC m=+5870.083619214" watchObservedRunningTime="2026-11-03 18:54:29.88281488 +0000 UTC m=+5870.084152931"
Nov 03 18:54:35.771784 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:35.771748    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-669c98d779-np82t"
Nov 03 18:54:37.045163 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:54:37.045130    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:54:44.015214 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:44.015172    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"]
Nov 03 18:54:44.015745 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:44.015416    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv" podUID="be247f01-f07d-4817-b877-d040866e420e" containerName="maas-api" containerID="cri-o://4996718da077ceff5e8d1326eef7c2275f1222a4f1cce72d3df682166ff7271a" gracePeriod=30
Nov 03 18:54:44.279416 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:44.279324    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv" podUID="be247f01-f07d-4817-b877-d040866e420e" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.49:8443/health\": dial tcp 10.132.0.49:8443: connect: connection refused"
Nov 03 18:54:45.276167 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.276138    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 18:54:45.417736 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.417635    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/be247f01-f07d-4817-b877-d040866e420e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be247f01-f07d-4817-b877-d040866e420e-openshift-service-ca\") pod \"be247f01-f07d-4817-b877-d040866e420e\" (UID: \"be247f01-f07d-4817-b877-d040866e420e\") "
Nov 03 18:54:45.417736 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.417703    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be247f01-f07d-4817-b877-d040866e420e-kube-api-access-wld7g\" (UniqueName: \"kubernetes.io/projected/be247f01-f07d-4817-b877-d040866e420e-kube-api-access-wld7g\") pod \"be247f01-f07d-4817-b877-d040866e420e\" (UID: \"be247f01-f07d-4817-b877-d040866e420e\") "
Nov 03 18:54:45.417963 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.417819    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/be247f01-f07d-4817-b877-d040866e420e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/be247f01-f07d-4817-b877-d040866e420e-metrics-certs\") pod \"be247f01-f07d-4817-b877-d040866e420e\" (UID: \"be247f01-f07d-4817-b877-d040866e420e\") "
Nov 03 18:54:45.417963 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.417907    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/be247f01-f07d-4817-b877-d040866e420e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be247f01-f07d-4817-b877-d040866e420e-maas-api-tls\") pod \"be247f01-f07d-4817-b877-d040866e420e\" (UID: \"be247f01-f07d-4817-b877-d040866e420e\") "
Nov 03 18:54:45.418140 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.418108    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be247f01-f07d-4817-b877-d040866e420e-openshift-service-ca" pod "be247f01-f07d-4817-b877-d040866e420e" (UID: "be247f01-f07d-4817-b877-d040866e420e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 18:54:45.418542 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.418297    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be247f01-f07d-4817-b877-d040866e420e-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:54:45.428007 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.420814    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be247f01-f07d-4817-b877-d040866e420e-maas-api-tls" pod "be247f01-f07d-4817-b877-d040866e420e" (UID: "be247f01-f07d-4817-b877-d040866e420e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 18:54:45.428007 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.420816    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be247f01-f07d-4817-b877-d040866e420e-kube-api-access-wld7g" pod "be247f01-f07d-4817-b877-d040866e420e" (UID: "be247f01-f07d-4817-b877-d040866e420e"). InnerVolumeSpecName "kube-api-access-wld7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 18:54:45.428007 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.420842    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be247f01-f07d-4817-b877-d040866e420e-metrics-certs" pod "be247f01-f07d-4817-b877-d040866e420e" (UID: "be247f01-f07d-4817-b877-d040866e420e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 18:54:45.519507 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.519469    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be247f01-f07d-4817-b877-d040866e420e-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:54:45.519507 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.519501    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wld7g\" (UniqueName: \"kubernetes.io/projected/be247f01-f07d-4817-b877-d040866e420e-kube-api-access-wld7g\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:54:45.519507 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.519511    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be247f01-f07d-4817-b877-d040866e420e-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 18:54:45.853859 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.853820    5021 generic.go:356] "Generic (PLEG): container finished" podID="be247f01-f07d-4817-b877-d040866e420e" containerID="4996718da077ceff5e8d1326eef7c2275f1222a4f1cce72d3df682166ff7271a" exitCode=0
Nov 03 18:54:45.854043 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.853878    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"
Nov 03 18:54:45.854043 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.853900    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv" event={"ID":"be247f01-f07d-4817-b877-d040866e420e","Type":"ContainerDied","Data":"4996718da077ceff5e8d1326eef7c2275f1222a4f1cce72d3df682166ff7271a"}
Nov 03 18:54:45.854043 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.853977    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv" event={"ID":"be247f01-f07d-4817-b877-d040866e420e","Type":"ContainerDied","Data":"5ae3379ff3784c9b9030c331edbdd8277b865531656202cade4236fb8c8013f4"}
Nov 03 18:54:45.854043 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.854000    5021 scope.go:122] "RemoveContainer" containerID="4996718da077ceff5e8d1326eef7c2275f1222a4f1cce72d3df682166ff7271a"
Nov 03 18:54:45.863698 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.863681    5021 scope.go:122] "RemoveContainer" containerID="4996718da077ceff5e8d1326eef7c2275f1222a4f1cce72d3df682166ff7271a"
Nov 03 18:54:45.863971 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:54:45.863955    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4996718da077ceff5e8d1326eef7c2275f1222a4f1cce72d3df682166ff7271a\": container with ID starting with 4996718da077ceff5e8d1326eef7c2275f1222a4f1cce72d3df682166ff7271a not found: ID does not exist" containerID="4996718da077ceff5e8d1326eef7c2275f1222a4f1cce72d3df682166ff7271a"
Nov 03 18:54:45.864014 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:45.863981    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4996718da077ceff5e8d1326eef7c2275f1222a4f1cce72d3df682166ff7271a"} err="failed to get container status \"4996718da077ceff5e8d1326eef7c2275f1222a4f1cce72d3df682166ff7271a\": rpc error: code = NotFound desc = could not find container \"4996718da077ceff5e8d1326eef7c2275f1222a4f1cce72d3df682166ff7271a\": container with ID starting with 4996718da077ceff5e8d1326eef7c2275f1222a4f1cce72d3df682166ff7271a not found: ID does not exist"
Nov 03 18:54:46.024983 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:46.024951    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"]
Nov 03 18:54:46.076879 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:46.076849    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-d6b5cbff-lmrkv"]
Nov 03 18:54:48.002760 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:54:48.002724    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="be247f01-f07d-4817-b877-d040866e420e" path="/var/lib/kubelet/pods/be247f01-f07d-4817-b877-d040866e420e/volumes"
Nov 03 18:55:07.046197 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:55:07.046111    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:55:37.045278 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:55:37.045220    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:56:07.044772 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:56:07.044732    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:56:37.045463 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:56:37.045426    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:56:40.909759 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:56:40.909649    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:56:40.914147 ip-10-0-137-219 kubenswrapper[5021]: I1103 18:56:40.914128    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 18:57:07.045865 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:57:07.045825    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:57:37.044933 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:57:37.044887    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:58:07.045354 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:58:07.045274    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:58:37.045276 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:58:37.045214    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:59:07.045534 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:59:07.045494    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 18:59:37.046864 ip-10-0-137-219 kubenswrapper[5021]: E1103 18:59:37.046771    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:00:07.049453 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:00:07.049415    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:00:17.730027 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:17.729973    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"]
Nov 03 19:00:17.730608 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:17.730270    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" containerID="cri-o://59cd95617fcd98ddcbb5219eadb8664de69143f4e8ce3c81c9b184a5b47283be" gracePeriod=30
Nov 03 19:00:17.782031 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:17.781998    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"]
Nov 03 19:00:17.782215 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:17.782193    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr" podUID="72ef520b-730f-45ee-a9cf-08513d927905" containerName="istio-proxy" containerID="cri-o://ad7e92471a11eb3d977f75f830629fa8f9f6663e1e0672380a87717b321b8e94" gracePeriod=30
Nov 03 19:00:19.887442 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:19.887403    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-xr7mz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 19:00:19.887849 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:19.887471    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 19:00:23.038004 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.037966    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 19:00:23.061449 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.061422    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 19:00:23.195386 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.195348    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64bed658-4022-47d6-84f0-c9d575ffb82d-kube-api-access-2fl8t\" (UniqueName: \"kubernetes.io/projected/64bed658-4022-47d6-84f0-c9d575ffb82d-kube-api-access-2fl8t\") pod \"64bed658-4022-47d6-84f0-c9d575ffb82d\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") "
Nov 03 19:00:23.195386 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.195389    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-podinfo\") pod \"64bed658-4022-47d6-84f0-c9d575ffb82d\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") "
Nov 03 19:00:23.195635 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.195419    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-workload-socket\") pod \"64bed658-4022-47d6-84f0-c9d575ffb82d\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") "
Nov 03 19:00:23.195635 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.195449    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-istio-data\") pod \"72ef520b-730f-45ee-a9cf-08513d927905\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") "
Nov 03 19:00:23.195635 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.195482    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-workload-certs\") pod \"64bed658-4022-47d6-84f0-c9d575ffb82d\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") "
Nov 03 19:00:23.195635 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.195529    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-credential-socket\") pod \"72ef520b-730f-45ee-a9cf-08513d927905\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") "
Nov 03 19:00:23.195635 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.195562    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/72ef520b-730f-45ee-a9cf-08513d927905-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72ef520b-730f-45ee-a9cf-08513d927905-istio-podinfo\") pod \"72ef520b-730f-45ee-a9cf-08513d927905\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") "
Nov 03 19:00:23.195905 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.195636    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-workload-certs\") pod \"72ef520b-730f-45ee-a9cf-08513d927905\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") "
Nov 03 19:00:23.195905 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.195669    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-istio-envoy\") pod \"72ef520b-730f-45ee-a9cf-08513d927905\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") "
Nov 03 19:00:23.195905 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.195747    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-workload-socket" pod "64bed658-4022-47d6-84f0-c9d575ffb82d" (UID: "64bed658-4022-47d6-84f0-c9d575ffb82d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 19:00:23.195905 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.195757    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-istio-data" pod "72ef520b-730f-45ee-a9cf-08513d927905" (UID: "72ef520b-730f-45ee-a9cf-08513d927905"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 19:00:23.195905 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.195836    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/72ef520b-730f-45ee-a9cf-08513d927905-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72ef520b-730f-45ee-a9cf-08513d927905-istiod-ca-cert\") pod \"72ef520b-730f-45ee-a9cf-08513d927905\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") "
Nov 03 19:00:23.195905 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.195850    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-workload-certs" pod "64bed658-4022-47d6-84f0-c9d575ffb82d" (UID: "64bed658-4022-47d6-84f0-c9d575ffb82d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 19:00:23.195905 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.195895    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72ef520b-730f-45ee-a9cf-08513d927905-kube-api-access-h8crr\" (UniqueName: \"kubernetes.io/projected/72ef520b-730f-45ee-a9cf-08513d927905-kube-api-access-h8crr\") pod \"72ef520b-730f-45ee-a9cf-08513d927905\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") "
Nov 03 19:00:23.196319 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.195936    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-envoy\") pod \"64bed658-4022-47d6-84f0-c9d575ffb82d\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") "
Nov 03 19:00:23.196319 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.195986    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-workload-certs" pod "72ef520b-730f-45ee-a9cf-08513d927905" (UID: "72ef520b-730f-45ee-a9cf-08513d927905"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 19:00:23.196319 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.195990    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72ef520b-730f-45ee-a9cf-08513d927905-istio-token\" (UniqueName: \"kubernetes.io/projected/72ef520b-730f-45ee-a9cf-08513d927905-istio-token\") pod \"72ef520b-730f-45ee-a9cf-08513d927905\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") "
Nov 03 19:00:23.196319 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.196079    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-token\" (UniqueName: \"kubernetes.io/projected/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-token\") pod \"64bed658-4022-47d6-84f0-c9d575ffb82d\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") "
Nov 03 19:00:23.196319 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.196108    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/64bed658-4022-47d6-84f0-c9d575ffb82d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64bed658-4022-47d6-84f0-c9d575ffb82d-istiod-ca-cert\") pod \"64bed658-4022-47d6-84f0-c9d575ffb82d\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") "
Nov 03 19:00:23.196319 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.196149    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-workload-socket\") pod \"72ef520b-730f-45ee-a9cf-08513d927905\" (UID: \"72ef520b-730f-45ee-a9cf-08513d927905\") "
Nov 03 19:00:23.196319 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.196178    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-credential-socket\") pod \"64bed658-4022-47d6-84f0-c9d575ffb82d\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") "
Nov 03 19:00:23.196319 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.196214    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-data\") pod \"64bed658-4022-47d6-84f0-c9d575ffb82d\" (UID: \"64bed658-4022-47d6-84f0-c9d575ffb82d\") "
Nov 03 19:00:23.196743 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.196584    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64bed658-4022-47d6-84f0-c9d575ffb82d-istiod-ca-cert" pod "64bed658-4022-47d6-84f0-c9d575ffb82d" (UID: "64bed658-4022-47d6-84f0-c9d575ffb82d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 19:00:23.197106 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.196804    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-data" pod "64bed658-4022-47d6-84f0-c9d575ffb82d" (UID: "64bed658-4022-47d6-84f0-c9d575ffb82d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 19:00:23.197106 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.196827    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64bed658-4022-47d6-84f0-c9d575ffb82d-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.197106 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.196849    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.197106 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.196866    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.197106 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.196880    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.197106 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.196893    5021 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-workload-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.197106 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.196980    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-credential-socket" pod "72ef520b-730f-45ee-a9cf-08513d927905" (UID: "72ef520b-730f-45ee-a9cf-08513d927905"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 19:00:23.197106 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.197020    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-workload-socket" pod "72ef520b-730f-45ee-a9cf-08513d927905" (UID: "72ef520b-730f-45ee-a9cf-08513d927905"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 19:00:23.197602 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.197211    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72ef520b-730f-45ee-a9cf-08513d927905-istiod-ca-cert" pod "72ef520b-730f-45ee-a9cf-08513d927905" (UID: "72ef520b-730f-45ee-a9cf-08513d927905"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 19:00:23.197602 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.197251    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-credential-socket" pod "64bed658-4022-47d6-84f0-c9d575ffb82d" (UID: "64bed658-4022-47d6-84f0-c9d575ffb82d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 19:00:23.198129 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.198103    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-podinfo" pod "64bed658-4022-47d6-84f0-c9d575ffb82d" (UID: "64bed658-4022-47d6-84f0-c9d575ffb82d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 19:00:23.198374 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.198348    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64bed658-4022-47d6-84f0-c9d575ffb82d-kube-api-access-2fl8t" pod "64bed658-4022-47d6-84f0-c9d575ffb82d" (UID: "64bed658-4022-47d6-84f0-c9d575ffb82d"). InnerVolumeSpecName "kube-api-access-2fl8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 19:00:23.198455 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.198428    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72ef520b-730f-45ee-a9cf-08513d927905-kube-api-access-h8crr" pod "72ef520b-730f-45ee-a9cf-08513d927905" (UID: "72ef520b-730f-45ee-a9cf-08513d927905"). InnerVolumeSpecName "kube-api-access-h8crr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 19:00:23.198865 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.198839    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/72ef520b-730f-45ee-a9cf-08513d927905-istio-podinfo" pod "72ef520b-730f-45ee-a9cf-08513d927905" (UID: "72ef520b-730f-45ee-a9cf-08513d927905"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 19:00:23.199355 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.199333    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-envoy" pod "64bed658-4022-47d6-84f0-c9d575ffb82d" (UID: "64bed658-4022-47d6-84f0-c9d575ffb82d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 19:00:23.199651 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.199622    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72ef520b-730f-45ee-a9cf-08513d927905-istio-token" pod "72ef520b-730f-45ee-a9cf-08513d927905" (UID: "72ef520b-730f-45ee-a9cf-08513d927905"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 19:00:23.200003 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.199979    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-istio-envoy" pod "72ef520b-730f-45ee-a9cf-08513d927905" (UID: "72ef520b-730f-45ee-a9cf-08513d927905"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 19:00:23.200081 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.200001    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-token" pod "64bed658-4022-47d6-84f0-c9d575ffb82d" (UID: "64bed658-4022-47d6-84f0-c9d575ffb82d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 19:00:23.298310 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.298193    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8crr\" (UniqueName: \"kubernetes.io/projected/72ef520b-730f-45ee-a9cf-08513d927905-kube-api-access-h8crr\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.298310 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.298250    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.298310 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.298262    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72ef520b-730f-45ee-a9cf-08513d927905-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.298310 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.298274    5021 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-token\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.298310 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.298283    5021 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-workload-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.298310 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.298292    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.298310 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.298300    5021 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-data\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.298310 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.298309    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fl8t\" (UniqueName: \"kubernetes.io/projected/64bed658-4022-47d6-84f0-c9d575ffb82d-kube-api-access-2fl8t\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.298310 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.298318    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64bed658-4022-47d6-84f0-c9d575ffb82d-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.298723 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.298326    5021 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-credential-socket\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.298723 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.298335    5021 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72ef520b-730f-45ee-a9cf-08513d927905-istio-podinfo\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.298723 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.298343    5021 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72ef520b-730f-45ee-a9cf-08513d927905-istio-envoy\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.298723 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.298352    5021 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72ef520b-730f-45ee-a9cf-08513d927905-istiod-ca-cert\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:00:23.628131 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.628053    5021 generic.go:356] "Generic (PLEG): container finished" podID="72ef520b-730f-45ee-a9cf-08513d927905" containerID="ad7e92471a11eb3d977f75f830629fa8f9f6663e1e0672380a87717b321b8e94" exitCode=0
Nov 03 19:00:23.628131 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.628102    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"
Nov 03 19:00:23.628367 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.628144    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr" event={"ID":"72ef520b-730f-45ee-a9cf-08513d927905","Type":"ContainerDied","Data":"ad7e92471a11eb3d977f75f830629fa8f9f6663e1e0672380a87717b321b8e94"}
Nov 03 19:00:23.628367 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.628197    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr" event={"ID":"72ef520b-730f-45ee-a9cf-08513d927905","Type":"ContainerDied","Data":"da43564acb7f06a72d54618e07a71b9c7885aa60c4684563f6fefc1852661adc"}
Nov 03 19:00:23.628367 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.628246    5021 scope.go:122] "RemoveContainer" containerID="ad7e92471a11eb3d977f75f830629fa8f9f6663e1e0672380a87717b321b8e94"
Nov 03 19:00:23.629629 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.629602    5021 generic.go:356] "Generic (PLEG): container finished" podID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerID="59cd95617fcd98ddcbb5219eadb8664de69143f4e8ce3c81c9b184a5b47283be" exitCode=0
Nov 03 19:00:23.629757 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.629645    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"
Nov 03 19:00:23.629757 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.629673    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" event={"ID":"64bed658-4022-47d6-84f0-c9d575ffb82d","Type":"ContainerDied","Data":"59cd95617fcd98ddcbb5219eadb8664de69143f4e8ce3c81c9b184a5b47283be"}
Nov 03 19:00:23.629757 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.629724    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz" event={"ID":"64bed658-4022-47d6-84f0-c9d575ffb82d","Type":"ContainerDied","Data":"af9e0800877ac832fd06e6750da09613eef516f633970e031ac13be3fb05cd44"}
Nov 03 19:00:23.638430 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.638413    5021 scope.go:122] "RemoveContainer" containerID="ad7e92471a11eb3d977f75f830629fa8f9f6663e1e0672380a87717b321b8e94"
Nov 03 19:00:23.638701 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:00:23.638683    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad7e92471a11eb3d977f75f830629fa8f9f6663e1e0672380a87717b321b8e94\": container with ID starting with ad7e92471a11eb3d977f75f830629fa8f9f6663e1e0672380a87717b321b8e94 not found: ID does not exist" containerID="ad7e92471a11eb3d977f75f830629fa8f9f6663e1e0672380a87717b321b8e94"
Nov 03 19:00:23.638769 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.638713    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad7e92471a11eb3d977f75f830629fa8f9f6663e1e0672380a87717b321b8e94"} err="failed to get container status \"ad7e92471a11eb3d977f75f830629fa8f9f6663e1e0672380a87717b321b8e94\": rpc error: code = NotFound desc = could not find container \"ad7e92471a11eb3d977f75f830629fa8f9f6663e1e0672380a87717b321b8e94\": container with ID starting with ad7e92471a11eb3d977f75f830629fa8f9f6663e1e0672380a87717b321b8e94 not found: ID does not exist"
Nov 03 19:00:23.638769 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.638738    5021 scope.go:122] "RemoveContainer" containerID="59cd95617fcd98ddcbb5219eadb8664de69143f4e8ce3c81c9b184a5b47283be"
Nov 03 19:00:23.647996 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.647975    5021 scope.go:122] "RemoveContainer" containerID="59cd95617fcd98ddcbb5219eadb8664de69143f4e8ce3c81c9b184a5b47283be"
Nov 03 19:00:23.648296 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:00:23.648270    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59cd95617fcd98ddcbb5219eadb8664de69143f4e8ce3c81c9b184a5b47283be\": container with ID starting with 59cd95617fcd98ddcbb5219eadb8664de69143f4e8ce3c81c9b184a5b47283be not found: ID does not exist" containerID="59cd95617fcd98ddcbb5219eadb8664de69143f4e8ce3c81c9b184a5b47283be"
Nov 03 19:00:23.648391 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.648305    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59cd95617fcd98ddcbb5219eadb8664de69143f4e8ce3c81c9b184a5b47283be"} err="failed to get container status \"59cd95617fcd98ddcbb5219eadb8664de69143f4e8ce3c81c9b184a5b47283be\": rpc error: code = NotFound desc = could not find container \"59cd95617fcd98ddcbb5219eadb8664de69143f4e8ce3c81c9b184a5b47283be\": container with ID starting with 59cd95617fcd98ddcbb5219eadb8664de69143f4e8ce3c81c9b184a5b47283be not found: ID does not exist"
Nov 03 19:00:23.799263 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.799214    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"]
Nov 03 19:00:23.851251 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.851187    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xr7mz"]
Nov 03 19:00:23.920145 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.920063    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"]
Nov 03 19:00:23.924448 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:23.924419    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-xhtvr"]
Nov 03 19:00:24.002245 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:24.002205    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" path="/var/lib/kubelet/pods/64bed658-4022-47d6-84f0-c9d575ffb82d/volumes"
Nov 03 19:00:24.002721 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:00:24.002705    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="72ef520b-730f-45ee-a9cf-08513d927905" path="/var/lib/kubelet/pods/72ef520b-730f-45ee-a9cf-08513d927905/volumes"
Nov 03 19:00:37.045802 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:00:37.045764    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:01:07.045586 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:01:07.045510    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:01:37.045722 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:01:37.045683    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:01:40.944029 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:01:40.943915    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 19:01:40.950280 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:01:40.950256    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 19:02:07.045781 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:02:07.045736    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:02:37.045931 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:02:37.045851    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:02:48.927408 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.927367    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"]
Nov 03 19:02:48.927898 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.927810    5021 cpu_manager.go:414] "containerMap: removing container" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy"
Nov 03 19:02:48.927898 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.927822    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy"
Nov 03 19:02:48.927898 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.927858    5021 cpu_manager.go:414] "containerMap: removing container" podUID="72ef520b-730f-45ee-a9cf-08513d927905" containerName="istio-proxy"
Nov 03 19:02:48.927898 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.927863    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72ef520b-730f-45ee-a9cf-08513d927905" containerName="istio-proxy"
Nov 03 19:02:48.927898 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.927875    5021 cpu_manager.go:414] "containerMap: removing container" podUID="be247f01-f07d-4817-b877-d040866e420e" containerName="maas-api"
Nov 03 19:02:48.927898 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.927880    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be247f01-f07d-4817-b877-d040866e420e" containerName="maas-api"
Nov 03 19:02:48.928090 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.927948    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="be247f01-f07d-4817-b877-d040866e420e" containerName="maas-api"
Nov 03 19:02:48.928090 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.927959    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="64bed658-4022-47d6-84f0-c9d575ffb82d" containerName="istio-proxy"
Nov 03 19:02:48.928090 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.927967    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="72ef520b-730f-45ee-a9cf-08513d927905" containerName="istio-proxy"
Nov 03 19:02:48.931269 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.931252    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:48.976404 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.976367    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d05521-4431-4dca-85e3-bc3d881dfe1f-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:48.976578 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.976422    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d05521-4431-4dca-85e3-bc3d881dfe1f-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:48.976578 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.976511    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wljv2\" (UniqueName: \"kubernetes.io/projected/90d05521-4431-4dca-85e3-bc3d881dfe1f-kube-api-access-wljv2\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:48.976578 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.976573    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90d05521-4431-4dca-85e3-bc3d881dfe1f-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:48.976706 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.976599    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90d05521-4431-4dca-85e3-bc3d881dfe1f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:48.976706 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.976627    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90d05521-4431-4dca-85e3-bc3d881dfe1f-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:48.976706 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.976687    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90d05521-4431-4dca-85e3-bc3d881dfe1f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:48.976939 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.976723    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90d05521-4431-4dca-85e3-bc3d881dfe1f-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:48.976939 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:48.976859    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90d05521-4431-4dca-85e3-bc3d881dfe1f-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.077881 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.077839    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d05521-4431-4dca-85e3-bc3d881dfe1f-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.078089 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.077889    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wljv2\" (UniqueName: \"kubernetes.io/projected/90d05521-4431-4dca-85e3-bc3d881dfe1f-kube-api-access-wljv2\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.078089 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.077929    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90d05521-4431-4dca-85e3-bc3d881dfe1f-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.078089 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.077954    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90d05521-4431-4dca-85e3-bc3d881dfe1f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.078089 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.077990    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90d05521-4431-4dca-85e3-bc3d881dfe1f-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.078089 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.078014    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90d05521-4431-4dca-85e3-bc3d881dfe1f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.078089 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.078054    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90d05521-4431-4dca-85e3-bc3d881dfe1f-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.078503 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.078153    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90d05521-4431-4dca-85e3-bc3d881dfe1f-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.078503 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.078181    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d05521-4431-4dca-85e3-bc3d881dfe1f-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.078503 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.078327    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d05521-4431-4dca-85e3-bc3d881dfe1f-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.078503 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.078364    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90d05521-4431-4dca-85e3-bc3d881dfe1f-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.078503 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.078401    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90d05521-4431-4dca-85e3-bc3d881dfe1f-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.078730 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.078578    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d05521-4431-4dca-85e3-bc3d881dfe1f-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.078877 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.078857    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90d05521-4431-4dca-85e3-bc3d881dfe1f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.080445 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.080420    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90d05521-4431-4dca-85e3-bc3d881dfe1f-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.080559 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.080545    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90d05521-4431-4dca-85e3-bc3d881dfe1f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.136839 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.136800    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"]
Nov 03 19:02:49.141166 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.141134    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90d05521-4431-4dca-85e3-bc3d881dfe1f-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.141386 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.141365    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wljv2\" (UniqueName: \"kubernetes.io/projected/90d05521-4431-4dca-85e3-bc3d881dfe1f-kube-api-access-wljv2\") pod \"maas-default-gateway-openshift-default-58c6585447-7q4j8\" (UID: \"90d05521-4431-4dca-85e3-bc3d881dfe1f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.243634 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.243548    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:49.678353 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.678328    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"]
Nov 03 19:02:49.680134 ip-10-0-137-219 kubenswrapper[5021]: W1103 19:02:49.680104    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90d05521_4431_4dca_85e3_bc3d881dfe1f.slice/crio-1d2dfb55b1b9190edad4c6e9b26f90d98951ff50149374991e1bf07795c4cf22 WatchSource:0}: Error finding container 1d2dfb55b1b9190edad4c6e9b26f90d98951ff50149374991e1bf07795c4cf22: Status 404 returned error can't find the container with id 1d2dfb55b1b9190edad4c6e9b26f90d98951ff50149374991e1bf07795c4cf22
Nov 03 19:02:49.682235 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.682187    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 19:02:49.682350 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.682282    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 19:02:49.682350 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:49.682326    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 19:02:50.402025 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:50.401991    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8" event={"ID":"90d05521-4431-4dca-85e3-bc3d881dfe1f","Type":"ContainerStarted","Data":"90b580634be203786a913fd18e798916768f2d4faa667f81f36e14b71f4574af"}
Nov 03 19:02:50.402467 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:50.402049    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8" event={"ID":"90d05521-4431-4dca-85e3-bc3d881dfe1f","Type":"ContainerStarted","Data":"1d2dfb55b1b9190edad4c6e9b26f90d98951ff50149374991e1bf07795c4cf22"}
Nov 03 19:02:50.644250 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:50.643569    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8" podStartSLOduration=2.6435470370000003 podStartE2EDuration="2.643547037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:02:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:02:50.578002885 +0000 UTC m=+6370.779340938" watchObservedRunningTime="2026-11-03 19:02:50.643547037 +0000 UTC m=+6370.844885091"
Nov 03 19:02:51.249047 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:51.249003    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:51.249384 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:51.249341    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7q4j8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Nov 03 19:02:51.249519 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:51.249417    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8" podUID="90d05521-4431-4dca-85e3-bc3d881dfe1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Nov 03 19:02:52.249252 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:52.247676    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7q4j8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Nov 03 19:02:52.249252 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:52.247751    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8" podUID="90d05521-4431-4dca-85e3-bc3d881dfe1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Nov 03 19:02:53.251413 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:53.251373    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7q4j8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Nov 03 19:02:53.251928 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:53.251510    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8" podUID="90d05521-4431-4dca-85e3-bc3d881dfe1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Nov 03 19:02:54.249673 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:54.249629    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7q4j8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Nov 03 19:02:54.249903 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:54.249704    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8" podUID="90d05521-4431-4dca-85e3-bc3d881dfe1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Nov 03 19:02:55.245631 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:55.245593    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7q4j8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Nov 03 19:02:55.246407 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:55.246373    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8" podUID="90d05521-4431-4dca-85e3-bc3d881dfe1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Nov 03 19:02:56.244548 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:56.244515    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7q4j8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Nov 03 19:02:56.244718 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:56.244572    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8" podUID="90d05521-4431-4dca-85e3-bc3d881dfe1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Nov 03 19:02:57.244079 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:57.244042    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7q4j8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Nov 03 19:02:57.244533 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:57.244098    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8" podUID="90d05521-4431-4dca-85e3-bc3d881dfe1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Nov 03 19:02:59.178756 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:59.178721    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:59.179250 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:59.179164    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:02:59.180146 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:02:59.180119    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8"
Nov 03 19:03:07.046021 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:03:07.045978    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:03:37.045579 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:03:37.045533    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:04:07.046386 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:04:07.046294    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:04:19.710573 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.710537    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"]
Nov 03 19:04:19.716087 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.716060    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.808006 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.807954    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.808202 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.808086    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.808202 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.808139    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr6sv\" (UniqueName: \"kubernetes.io/projected/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-kube-api-access-jr6sv\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.808202 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.808175    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.808579 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.808328    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.808579 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.808362    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.808579 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.808383    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.808579 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.808485    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.808579 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.808517    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.909400 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.909369    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.909612 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.909409    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.909612 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.909427    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.909612 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.909462    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.909612 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.909492    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.909612 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.909539    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.909612 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.909587    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.909951 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.909618    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr6sv\" (UniqueName: \"kubernetes.io/projected/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-kube-api-access-jr6sv\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.909951 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.909650    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.910037 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.909970    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.910037 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.910011    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.910215 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.910189    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.910364 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.910290    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.910364 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.910327    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.911835 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.911814    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.912154 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.912134    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.927528 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.927493    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"]
Nov 03 19:04:19.973103 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.973023    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:19.973291 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:19.973264    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr6sv\" (UniqueName: \"kubernetes.io/projected/0e75cfd4-5493-4f9e-9f1d-21af42b4ad96-kube-api-access-jr6sv\") pod \"maas-default-gateway-openshift-default-58c6585447-4ccf2\" (UID: \"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:20.030661 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:20.030627    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:20.461915 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:20.461892    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"]
Nov 03 19:04:20.463371 ip-10-0-137-219 kubenswrapper[5021]: W1103 19:04:20.463340    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e75cfd4_5493_4f9e_9f1d_21af42b4ad96.slice/crio-ae9aee40ada4402ed0819975766b48ba4c921293d6f39618ff425bf3f3d21480 WatchSource:0}: Error finding container ae9aee40ada4402ed0819975766b48ba4c921293d6f39618ff425bf3f3d21480: Status 404 returned error can't find the container with id ae9aee40ada4402ed0819975766b48ba4c921293d6f39618ff425bf3f3d21480
Nov 03 19:04:20.465531 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:20.465499    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 19:04:20.465617 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:20.465560    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 19:04:20.465617 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:20.465591    5021 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 03 19:04:20.894386 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:20.894350    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2" event={"ID":"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96","Type":"ContainerStarted","Data":"5f4f1c3ea2807c31bcb8394fe1b69e9251dcf04f158d652b2ab86531ecad9ff5"}
Nov 03 19:04:20.894879 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:20.894419    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2" event={"ID":"0e75cfd4-5493-4f9e-9f1d-21af42b4ad96","Type":"ContainerStarted","Data":"ae9aee40ada4402ed0819975766b48ba4c921293d6f39618ff425bf3f3d21480"}
Nov 03 19:04:21.047252 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:21.035160    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-4ccf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused" start-of-body=
Nov 03 19:04:21.047252 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:21.035251    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2" podUID="0e75cfd4-5493-4f9e-9f1d-21af42b4ad96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused"
Nov 03 19:04:21.047252 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:21.035522    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:22.043651 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:22.043611    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-4ccf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused" start-of-body=
Nov 03 19:04:22.044302 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:22.044267    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2" podUID="0e75cfd4-5493-4f9e-9f1d-21af42b4ad96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused"
Nov 03 19:04:23.044251 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:23.042635    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-4ccf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused" start-of-body=
Nov 03 19:04:23.044251 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:23.042701    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2" podUID="0e75cfd4-5493-4f9e-9f1d-21af42b4ad96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused"
Nov 03 19:04:24.046251 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:24.043519    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-4ccf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused" start-of-body=
Nov 03 19:04:24.046251 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:24.043582    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2" podUID="0e75cfd4-5493-4f9e-9f1d-21af42b4ad96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused"
Nov 03 19:04:25.040251 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:25.036657    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-4ccf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused" start-of-body=
Nov 03 19:04:25.040251 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:25.036723    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2" podUID="0e75cfd4-5493-4f9e-9f1d-21af42b4ad96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused"
Nov 03 19:04:26.042253 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:26.036613    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-4ccf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused" start-of-body=
Nov 03 19:04:26.042253 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:26.036676    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2" podUID="0e75cfd4-5493-4f9e-9f1d-21af42b4ad96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused"
Nov 03 19:04:27.031824 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:27.031788    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-4ccf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused" start-of-body=
Nov 03 19:04:27.032006 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:27.031842    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2" podUID="0e75cfd4-5493-4f9e-9f1d-21af42b4ad96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused"
Nov 03 19:04:28.030971 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:28.030934    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-4ccf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused" start-of-body=
Nov 03 19:04:28.031421 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:28.030986    5021 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2" podUID="0e75cfd4-5493-4f9e-9f1d-21af42b4ad96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused"
Nov 03 19:04:29.721393 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:29.721345    5021 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:29.721892 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:29.721799    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:29.722754 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:29.722733    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2"
Nov 03 19:04:29.899220 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:04:29.899161    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2" podStartSLOduration=10.899148992 podStartE2EDuration="10.899148992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:04:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:04:21.145784387 +0000 UTC m=+6461.347122440" watchObservedRunningTime="2026-11-03 19:04:29.899148992 +0000 UTC m=+6470.100487043"
Nov 03 19:04:37.046477 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:04:37.046435    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:05:07.048277 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:05:07.048220    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:05:33.476664 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:33.476574    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"]
Nov 03 19:05:33.480372 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:33.480352    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:05:33.534635 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:33.534603    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-88025f84-serving-cert\""
Nov 03 19:05:33.590117 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:33.590078    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"]
Nov 03 19:05:33.644383 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:33.644344    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb12e76-69ee-4c84-affa-85931a30459d-maas-api-tls\") pod \"maas-api-e2e-mt-88025f84-644d895888-h7cps\" (UID: \"6bb12e76-69ee-4c84-affa-85931a30459d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:05:33.644588 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:33.644444    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bb12e76-69ee-4c84-affa-85931a30459d-metrics-certs\") pod \"maas-api-e2e-mt-88025f84-644d895888-h7cps\" (UID: \"6bb12e76-69ee-4c84-affa-85931a30459d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:05:33.644588 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:33.644486    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb12e76-69ee-4c84-affa-85931a30459d-openshift-service-ca\") pod \"maas-api-e2e-mt-88025f84-644d895888-h7cps\" (UID: \"6bb12e76-69ee-4c84-affa-85931a30459d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:05:33.644679 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:33.644653    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqp2z\" (UniqueName: \"kubernetes.io/projected/6bb12e76-69ee-4c84-affa-85931a30459d-kube-api-access-cqp2z\") pod \"maas-api-e2e-mt-88025f84-644d895888-h7cps\" (UID: \"6bb12e76-69ee-4c84-affa-85931a30459d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:05:33.745472 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:33.745386    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqp2z\" (UniqueName: \"kubernetes.io/projected/6bb12e76-69ee-4c84-affa-85931a30459d-kube-api-access-cqp2z\") pod \"maas-api-e2e-mt-88025f84-644d895888-h7cps\" (UID: \"6bb12e76-69ee-4c84-affa-85931a30459d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:05:33.745472 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:33.745462    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb12e76-69ee-4c84-affa-85931a30459d-maas-api-tls\") pod \"maas-api-e2e-mt-88025f84-644d895888-h7cps\" (UID: \"6bb12e76-69ee-4c84-affa-85931a30459d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:05:33.745688 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:33.745481    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bb12e76-69ee-4c84-affa-85931a30459d-metrics-certs\") pod \"maas-api-e2e-mt-88025f84-644d895888-h7cps\" (UID: \"6bb12e76-69ee-4c84-affa-85931a30459d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:05:33.745688 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:33.745502    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb12e76-69ee-4c84-affa-85931a30459d-openshift-service-ca\") pod \"maas-api-e2e-mt-88025f84-644d895888-h7cps\" (UID: \"6bb12e76-69ee-4c84-affa-85931a30459d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:05:33.746180 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:33.746154    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb12e76-69ee-4c84-affa-85931a30459d-openshift-service-ca\") pod \"maas-api-e2e-mt-88025f84-644d895888-h7cps\" (UID: \"6bb12e76-69ee-4c84-affa-85931a30459d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:05:33.748066 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:33.748046    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb12e76-69ee-4c84-affa-85931a30459d-maas-api-tls\") pod \"maas-api-e2e-mt-88025f84-644d895888-h7cps\" (UID: \"6bb12e76-69ee-4c84-affa-85931a30459d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:05:33.748182 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:33.748066    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bb12e76-69ee-4c84-affa-85931a30459d-metrics-certs\") pod \"maas-api-e2e-mt-88025f84-644d895888-h7cps\" (UID: \"6bb12e76-69ee-4c84-affa-85931a30459d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:05:33.808772 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:33.808734    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqp2z\" (UniqueName: \"kubernetes.io/projected/6bb12e76-69ee-4c84-affa-85931a30459d-kube-api-access-cqp2z\") pod \"maas-api-e2e-mt-88025f84-644d895888-h7cps\" (UID: \"6bb12e76-69ee-4c84-affa-85931a30459d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:05:34.093436 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:34.093396    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:05:34.475848 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:34.475823    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"]
Nov 03 19:05:34.478217 ip-10-0-137-219 kubenswrapper[5021]: W1103 19:05:34.478192    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb12e76_69ee_4c84_affa_85931a30459d.slice/crio-2f12b0b8f80b97a23db2802cc8771e7eceb3dc06a61593f1f477f2409babd8e3 WatchSource:0}: Error finding container 2f12b0b8f80b97a23db2802cc8771e7eceb3dc06a61593f1f477f2409babd8e3: Status 404 returned error can't find the container with id 2f12b0b8f80b97a23db2802cc8771e7eceb3dc06a61593f1f477f2409babd8e3
Nov 03 19:05:34.479553 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:34.479536    5021 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 19:05:35.283695 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:35.283658    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps" event={"ID":"6bb12e76-69ee-4c84-affa-85931a30459d","Type":"ContainerStarted","Data":"2f12b0b8f80b97a23db2802cc8771e7eceb3dc06a61593f1f477f2409babd8e3"}
Nov 03 19:05:36.290744 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:36.290700    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps" event={"ID":"6bb12e76-69ee-4c84-affa-85931a30459d","Type":"ContainerStarted","Data":"fc98d86a6f3dada7e6aaeadb6bd223aee39fb4d61c696c61533886d7b537dd94"}
Nov 03 19:05:36.291221 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:36.290833    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:05:36.414531 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:36.414474    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps" podStartSLOduration=2.531486887 podStartE2EDuration="3.414460063s" totalImagesPullingTime="882.973176ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:05:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:05:36.411998626 +0000 UTC m=+6536.613336690" watchObservedRunningTime="2026-11-03 19:05:36.414460063 +0000 UTC m=+6536.615798155"
Nov 03 19:05:37.045401 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:05:37.045365    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:05:42.303444 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:05:42.303411    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:06:07.045451 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:06:07.045407    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:06:37.044879 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:06:37.044844    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:06:40.984905 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:06:40.984791    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 19:06:40.991022 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:06:40.990995    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 19:07:07.045284 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:07:07.045189    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:07:32.200855 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.200823    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"]
Nov 03 19:07:32.201420 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.201032    5021 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps" podUID="6bb12e76-69ee-4c84-affa-85931a30459d" containerName="maas-api" containerID="cri-o://fc98d86a6f3dada7e6aaeadb6bd223aee39fb4d61c696c61533886d7b537dd94" gracePeriod=30
Nov 03 19:07:32.296353 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.296314    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps" podUID="6bb12e76-69ee-4c84-affa-85931a30459d" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.122:8443/health\": dial tcp 10.132.0.122:8443: connect: connection refused"
Nov 03 19:07:32.462914 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.462858    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:07:32.627534 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.627502    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6bb12e76-69ee-4c84-affa-85931a30459d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb12e76-69ee-4c84-affa-85931a30459d-openshift-service-ca\") pod \"6bb12e76-69ee-4c84-affa-85931a30459d\" (UID: \"6bb12e76-69ee-4c84-affa-85931a30459d\") "
Nov 03 19:07:32.627717 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.627552    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6bb12e76-69ee-4c84-affa-85931a30459d-kube-api-access-cqp2z\" (UniqueName: \"kubernetes.io/projected/6bb12e76-69ee-4c84-affa-85931a30459d-kube-api-access-cqp2z\") pod \"6bb12e76-69ee-4c84-affa-85931a30459d\" (UID: \"6bb12e76-69ee-4c84-affa-85931a30459d\") "
Nov 03 19:07:32.627717 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.627590    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6bb12e76-69ee-4c84-affa-85931a30459d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bb12e76-69ee-4c84-affa-85931a30459d-metrics-certs\") pod \"6bb12e76-69ee-4c84-affa-85931a30459d\" (UID: \"6bb12e76-69ee-4c84-affa-85931a30459d\") "
Nov 03 19:07:32.627717 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.627621    5021 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6bb12e76-69ee-4c84-affa-85931a30459d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb12e76-69ee-4c84-affa-85931a30459d-maas-api-tls\") pod \"6bb12e76-69ee-4c84-affa-85931a30459d\" (UID: \"6bb12e76-69ee-4c84-affa-85931a30459d\") "
Nov 03 19:07:32.627910 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.627869    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bb12e76-69ee-4c84-affa-85931a30459d-openshift-service-ca" pod "6bb12e76-69ee-4c84-affa-85931a30459d" (UID: "6bb12e76-69ee-4c84-affa-85931a30459d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 19:07:32.627983 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.627963    5021 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bb12e76-69ee-4c84-affa-85931a30459d-openshift-service-ca\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:07:32.629798 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.629765    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bb12e76-69ee-4c84-affa-85931a30459d-metrics-certs" pod "6bb12e76-69ee-4c84-affa-85931a30459d" (UID: "6bb12e76-69ee-4c84-affa-85931a30459d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 19:07:32.629919 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.629813    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bb12e76-69ee-4c84-affa-85931a30459d-maas-api-tls" pod "6bb12e76-69ee-4c84-affa-85931a30459d" (UID: "6bb12e76-69ee-4c84-affa-85931a30459d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 19:07:32.629919 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.629852    5021 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bb12e76-69ee-4c84-affa-85931a30459d-kube-api-access-cqp2z" pod "6bb12e76-69ee-4c84-affa-85931a30459d" (UID: "6bb12e76-69ee-4c84-affa-85931a30459d"). InnerVolumeSpecName "kube-api-access-cqp2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 19:07:32.729549 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.729453    5021 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqp2z\" (UniqueName: \"kubernetes.io/projected/6bb12e76-69ee-4c84-affa-85931a30459d-kube-api-access-cqp2z\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:07:32.729549 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.729495    5021 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bb12e76-69ee-4c84-affa-85931a30459d-metrics-certs\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:07:32.729549 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.729512    5021 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bb12e76-69ee-4c84-affa-85931a30459d-maas-api-tls\") on node \"ip-10-0-137-219.us-west-2.compute.internal\" DevicePath \"\""
Nov 03 19:07:32.900283 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.900250    5021 generic.go:356] "Generic (PLEG): container finished" podID="6bb12e76-69ee-4c84-affa-85931a30459d" containerID="fc98d86a6f3dada7e6aaeadb6bd223aee39fb4d61c696c61533886d7b537dd94" exitCode=0
Nov 03 19:07:32.900461 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.900362    5021 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"
Nov 03 19:07:32.900461 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.900365    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps" event={"ID":"6bb12e76-69ee-4c84-affa-85931a30459d","Type":"ContainerDied","Data":"fc98d86a6f3dada7e6aaeadb6bd223aee39fb4d61c696c61533886d7b537dd94"}
Nov 03 19:07:32.900561 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.900476    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps" event={"ID":"6bb12e76-69ee-4c84-affa-85931a30459d","Type":"ContainerDied","Data":"2f12b0b8f80b97a23db2802cc8771e7eceb3dc06a61593f1f477f2409babd8e3"}
Nov 03 19:07:32.900561 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.900499    5021 scope.go:122] "RemoveContainer" containerID="fc98d86a6f3dada7e6aaeadb6bd223aee39fb4d61c696c61533886d7b537dd94"
Nov 03 19:07:32.910290 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.910267    5021 scope.go:122] "RemoveContainer" containerID="fc98d86a6f3dada7e6aaeadb6bd223aee39fb4d61c696c61533886d7b537dd94"
Nov 03 19:07:32.910539 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:07:32.910517    5021 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc98d86a6f3dada7e6aaeadb6bd223aee39fb4d61c696c61533886d7b537dd94\": container with ID starting with fc98d86a6f3dada7e6aaeadb6bd223aee39fb4d61c696c61533886d7b537dd94 not found: ID does not exist" containerID="fc98d86a6f3dada7e6aaeadb6bd223aee39fb4d61c696c61533886d7b537dd94"
Nov 03 19:07:32.910592 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:32.910554    5021 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc98d86a6f3dada7e6aaeadb6bd223aee39fb4d61c696c61533886d7b537dd94"} err="failed to get container status \"fc98d86a6f3dada7e6aaeadb6bd223aee39fb4d61c696c61533886d7b537dd94\": rpc error: code = NotFound desc = could not find container \"fc98d86a6f3dada7e6aaeadb6bd223aee39fb4d61c696c61533886d7b537dd94\": container with ID starting with fc98d86a6f3dada7e6aaeadb6bd223aee39fb4d61c696c61533886d7b537dd94 not found: ID does not exist"
Nov 03 19:07:33.071796 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:33.071765    5021 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"]
Nov 03 19:07:33.123818 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:33.123787    5021 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-88025f84-644d895888-h7cps"]
Nov 03 19:07:34.002112 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:07:34.002078    5021 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6bb12e76-69ee-4c84-affa-85931a30459d" path="/var/lib/kubelet/pods/6bb12e76-69ee-4c84-affa-85931a30459d/volumes"
Nov 03 19:07:37.045720 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:07:37.045681    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:08:00.230437 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:08:00.230369    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7q4j8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 19:08:00.231126 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:08:00.231082    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8" podUID="90d05521-4431-4dca-85e3-bc3d881dfe1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 19:08:00.657426 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:08:00.657384    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-sz4qn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 19:08:00.657749 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:08:00.657716    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" podUID="5bacd2fb-f446-4db3-bb86-92a9d923a034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 19:08:00.763401 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:08:00.763358    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-4ccf2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.121:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 19:08:00.763595 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:08:00.763434    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2" podUID="0e75cfd4-5493-4f9e-9f1d-21af42b4ad96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.121:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 19:08:07.045345 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:08:07.045306    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:08:37.052152 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:08:37.052056    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:09:07.045068 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:09:07.045031    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:09:37.045933 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:09:37.045895    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:10:07.045647 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:10:07.045558    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:10:37.045359 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:10:37.045317    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:11:07.049347 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:11:07.049302    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:11:37.109217 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:11:37.109173    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:11:41.020713 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:11:41.020685    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 19:11:41.029596 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:11:41.029574    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6fwkq_0caf85ea-1bec-4670-a2e1-3cafd0e5a587/console-operator/2.log"
Nov 03 19:12:00.228435 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:12:00.228384    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7q4j8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 19:12:00.228973 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:12:00.228469    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8" podUID="90d05521-4431-4dca-85e3-bc3d881dfe1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 19:12:07.044687 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:12:07.044643    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:12:37.047018 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:12:37.046976    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:13:07.044806 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:13:07.044726    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:13:37.045015 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:13:37.044979    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:13:45.229250 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:13:45.228341    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-7q4j8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 19:13:45.229250 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:13:45.228415    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-7q4j8" podUID="90d05521-4431-4dca-85e3-bc3d881dfe1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 19:13:45.660250 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:13:45.659351    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-sz4qn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 19:13:45.660250 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:13:45.659434    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-sz4qn" podUID="5bacd2fb-f446-4db3-bb86-92a9d923a034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 19:13:45.779251 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:13:45.776348    5021 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-4ccf2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.121:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 19:13:45.779251 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:13:45.776452    5021 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-4ccf2" podUID="0e75cfd4-5493-4f9e-9f1d-21af42b4ad96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.121:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 19:14:07.044725 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:14:07.044685    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:14:13.708646 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:14:13.708608    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56c4996b4f-m8ksh_9f57c4b3-a9e2-4e43-ac33-3f75957f0668/authorino/0.log"
Nov 03 19:14:28.468757 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:14:28.468677    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-kfwnf_449ee7b6-e6dd-4aef-933c-722a0eb63ae1/server/0.log"
Nov 03 19:14:28.793646 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:14:28.793613    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-sg7cz_321a5ab2-29da-497d-83ac-68121f5fe200/manager/0.log"
Nov 03 19:14:29.131300 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:14:29.131204    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-jvcqp_782d07ab-b807-400c-b2b2-74989c3f84e9/proxy/0.log"
Nov 03 19:14:31.056943 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:14:31.056911    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-669c98d779-np82t_a598e016-3fb9-494c-aa41-cb88d6125691/maas-api/0.log"
Nov 03 19:14:35.268193 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:14:35.268159    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-lb5kg_b4547a2f-d1ef-4d57-8e42-0f0b2da011fb/postgres/0.log"
Nov 03 19:14:37.044330 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:14:37.044298    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:14:37.292173 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:14:37.292138    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56c4996b4f-m8ksh_9f57c4b3-a9e2-4e43-ac33-3f75957f0668/authorino/0.log"
Nov 03 19:14:40.825482 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:14:40.825445    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-bbqqn_21278b76-fc4f-45fc-96d3-e8898bead3dd/manager/0.log"
Nov 03 19:14:42.632089 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:14:42.632052    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fc78d544-6rgm9_bc948976-0edc-4e93-a9a9-58a58432b280/kube-auth-proxy/0.log"
Nov 03 19:14:43.092364 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:14:43.092329    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-4ccf2_0e75cfd4-5493-4f9e-9f1d-21af42b4ad96/istio-proxy/0.log"
Nov 03 19:14:43.375239 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:14:43.375142    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-7q4j8_90d05521-4431-4dca-85e3-bc3d881dfe1f/istio-proxy/0.log"
Nov 03 19:14:44.644452 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:14:44.644421    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-sz4qn_5bacd2fb-f446-4db3-bb86-92a9d923a034/istio-proxy/0.log"
Nov 03 19:14:46.413045 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:14:46.413012    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-678bd9c4d9-wrhq6_12b0e63f-73f7-429a-879d-617267cc5f36/router/0.log"
Nov 03 19:14:47.540493 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:14:47.540466    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-cmnlg_28b51572-e1b1-4c85-bd00-b3cf3ef2255a/main/0.log"
Nov 03 19:14:47.827941 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:14:47.827864    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-zj4jw_3dcbc998-663a-49f1-a8e3-cb5515916207/main/0.log"
Nov 03 19:14:48.122027 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:14:48.121943    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-w5kj5_23ad22c7-395e-4be2-8b50-d594809fbfb5/main/0.log"
Nov 03 19:14:49.030202 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:14:49.030162    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-46qzk_cbbe389f-0834-40b5-8681-06f9c206986c/main/0.log"
Nov 03 19:15:00.370892 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:00.370859    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-45cfb/must-gather-9vbgg"]
Nov 03 19:15:00.371338 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:00.371324    5021 cpu_manager.go:414] "containerMap: removing container" podUID="6bb12e76-69ee-4c84-affa-85931a30459d" containerName="maas-api"
Nov 03 19:15:00.371388 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:00.371339    5021 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6bb12e76-69ee-4c84-affa-85931a30459d" containerName="maas-api"
Nov 03 19:15:00.371437 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:00.371426    5021 memory_manager.go:365] "RemoveStaleState removing state" podUID="6bb12e76-69ee-4c84-affa-85931a30459d" containerName="maas-api"
Nov 03 19:15:00.374896 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:00.374877    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-45cfb/must-gather-9vbgg"
Nov 03 19:15:00.431841 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:00.431811    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-45cfb/must-gather-9vbgg"]
Nov 03 19:15:00.481151 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:00.481122    5021 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-45cfb\"/\"default-dockercfg-chcxq\""
Nov 03 19:15:00.481151 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:00.481123    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-45cfb\"/\"kube-root-ca.crt\""
Nov 03 19:15:00.481151 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:00.481146    5021 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-45cfb\"/\"openshift-service-ca.crt\""
Nov 03 19:15:00.496179 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:00.496152    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e63023f6-b80c-42bc-ac93-e33227401a76-must-gather-output\") pod \"must-gather-9vbgg\" (UID: \"e63023f6-b80c-42bc-ac93-e33227401a76\") " pod="openshift-must-gather-45cfb/must-gather-9vbgg"
Nov 03 19:15:00.496318 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:00.496194    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh2n6\" (UniqueName: \"kubernetes.io/projected/e63023f6-b80c-42bc-ac93-e33227401a76-kube-api-access-rh2n6\") pod \"must-gather-9vbgg\" (UID: \"e63023f6-b80c-42bc-ac93-e33227401a76\") " pod="openshift-must-gather-45cfb/must-gather-9vbgg"
Nov 03 19:15:00.597463 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:00.597427    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e63023f6-b80c-42bc-ac93-e33227401a76-must-gather-output\") pod \"must-gather-9vbgg\" (UID: \"e63023f6-b80c-42bc-ac93-e33227401a76\") " pod="openshift-must-gather-45cfb/must-gather-9vbgg"
Nov 03 19:15:00.597463 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:00.597469    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh2n6\" (UniqueName: \"kubernetes.io/projected/e63023f6-b80c-42bc-ac93-e33227401a76-kube-api-access-rh2n6\") pod \"must-gather-9vbgg\" (UID: \"e63023f6-b80c-42bc-ac93-e33227401a76\") " pod="openshift-must-gather-45cfb/must-gather-9vbgg"
Nov 03 19:15:00.597849 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:00.597825    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e63023f6-b80c-42bc-ac93-e33227401a76-must-gather-output\") pod \"must-gather-9vbgg\" (UID: \"e63023f6-b80c-42bc-ac93-e33227401a76\") " pod="openshift-must-gather-45cfb/must-gather-9vbgg"
Nov 03 19:15:00.661773 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:00.661701    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh2n6\" (UniqueName: \"kubernetes.io/projected/e63023f6-b80c-42bc-ac93-e33227401a76-kube-api-access-rh2n6\") pod \"must-gather-9vbgg\" (UID: \"e63023f6-b80c-42bc-ac93-e33227401a76\") " pod="openshift-must-gather-45cfb/must-gather-9vbgg"
Nov 03 19:15:00.688660 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:00.688634    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-45cfb/must-gather-9vbgg"
Nov 03 19:15:01.067304 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:01.067259    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-45cfb/must-gather-9vbgg"]
Nov 03 19:15:01.069656 ip-10-0-137-219 kubenswrapper[5021]: W1103 19:15:01.069626    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode63023f6_b80c_42bc_ac93_e33227401a76.slice/crio-71c6f53cd18811cd08da484bb7f981e8399df1f3c82f91b63dcad8c92cc6d1a5 WatchSource:0}: Error finding container 71c6f53cd18811cd08da484bb7f981e8399df1f3c82f91b63dcad8c92cc6d1a5: Status 404 returned error can't find the container with id 71c6f53cd18811cd08da484bb7f981e8399df1f3c82f91b63dcad8c92cc6d1a5
Nov 03 19:15:01.071515 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:01.071498    5021 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 19:15:01.824814 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:01.824780    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-45cfb/must-gather-9vbgg" event={"ID":"e63023f6-b80c-42bc-ac93-e33227401a76","Type":"ContainerStarted","Data":"71c6f53cd18811cd08da484bb7f981e8399df1f3c82f91b63dcad8c92cc6d1a5"}
Nov 03 19:15:02.833175 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:02.833128    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-45cfb/must-gather-9vbgg" event={"ID":"e63023f6-b80c-42bc-ac93-e33227401a76","Type":"ContainerStarted","Data":"5ad574cfcca71e70454e683747d51bfc0ef77946a578b7edbf87ad21da54027d"}
Nov 03 19:15:02.833681 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:02.833192    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-45cfb/must-gather-9vbgg" event={"ID":"e63023f6-b80c-42bc-ac93-e33227401a76","Type":"ContainerStarted","Data":"eb10a1951da086660250a972ec273e8a72bcc7f9a73c735effd164d35a316382"}
Nov 03 19:15:02.954852 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:02.954794    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-45cfb/must-gather-9vbgg" podStartSLOduration=1.6801156929999999 podStartE2EDuration="2.954779256s" totalImagesPullingTime="1.274663563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:15:02.952945545 +0000 UTC m=+7103.154283596" watchObservedRunningTime="2026-11-03 19:15:02.954779256 +0000 UTC m=+7103.156117307"
Nov 03 19:15:07.048387 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:15:07.048347    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:15:09.780246 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:09.779423    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cfrm8_10d51151-30e6-4c36-a13b-5af9c5ba56e8/global-pull-secret-syncer/0.log"
Nov 03 19:15:11.621295 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:11.619818    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-8dw9x_cf675d26-93c5-4a45-90db-7f95e260ac30/connection-checker/0.log"
Nov 03 19:15:12.065249 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:12.064722    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-kpfdx_749ecc85-b28a-4ecd-aaf0-27de9c332713/connection-checker/0.log"
Nov 03 19:15:12.516245 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:12.515284    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-vgvw9_951f5784-32a9-40a3-b503-33249c04d5fc/connection-checker/0.log"
Nov 03 19:15:13.464301 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:13.463212    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jjqzh_f11f9269-8c8d-43da-a7f6-c766c17793c4/konnectivity-agent/0.log"
Nov 03 19:15:15.127251 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:15.126457    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-219.us-west-2.compute.internal_eb1cf377fcbbbe2547aa17b485064a9c/haproxy/0.log"
Nov 03 19:15:18.571622 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:18.571581    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56c4996b4f-m8ksh_9f57c4b3-a9e2-4e43-ac33-3f75957f0668/authorino/0.log"
Nov 03 19:15:20.253166 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.253128    5021 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"]
Nov 03 19:15:20.261440 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.261412    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:20.316111 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.316071    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"]
Nov 03 19:15:20.359046 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.359008    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f209ecd1-bf0d-42de-942f-42f1ffa322c1-lib-modules\") pod \"perf-node-gather-daemonset-ps2t9\" (UID: \"f209ecd1-bf0d-42de-942f-42f1ffa322c1\") " pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:20.359236 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.359135    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f209ecd1-bf0d-42de-942f-42f1ffa322c1-sys\") pod \"perf-node-gather-daemonset-ps2t9\" (UID: \"f209ecd1-bf0d-42de-942f-42f1ffa322c1\") " pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:20.359317 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.359258    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnkxj\" (UniqueName: \"kubernetes.io/projected/f209ecd1-bf0d-42de-942f-42f1ffa322c1-kube-api-access-lnkxj\") pod \"perf-node-gather-daemonset-ps2t9\" (UID: \"f209ecd1-bf0d-42de-942f-42f1ffa322c1\") " pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:20.359372 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.359354    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f209ecd1-bf0d-42de-942f-42f1ffa322c1-proc\") pod \"perf-node-gather-daemonset-ps2t9\" (UID: \"f209ecd1-bf0d-42de-942f-42f1ffa322c1\") " pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:20.359414 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.359391    5021 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f209ecd1-bf0d-42de-942f-42f1ffa322c1-podres\") pod \"perf-node-gather-daemonset-ps2t9\" (UID: \"f209ecd1-bf0d-42de-942f-42f1ffa322c1\") " pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:20.460784 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.460749    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f209ecd1-bf0d-42de-942f-42f1ffa322c1-sys\") pod \"perf-node-gather-daemonset-ps2t9\" (UID: \"f209ecd1-bf0d-42de-942f-42f1ffa322c1\") " pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:20.460977 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.460803    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnkxj\" (UniqueName: \"kubernetes.io/projected/f209ecd1-bf0d-42de-942f-42f1ffa322c1-kube-api-access-lnkxj\") pod \"perf-node-gather-daemonset-ps2t9\" (UID: \"f209ecd1-bf0d-42de-942f-42f1ffa322c1\") " pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:20.460977 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.460854    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f209ecd1-bf0d-42de-942f-42f1ffa322c1-sys\") pod \"perf-node-gather-daemonset-ps2t9\" (UID: \"f209ecd1-bf0d-42de-942f-42f1ffa322c1\") " pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:20.460977 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.460870    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f209ecd1-bf0d-42de-942f-42f1ffa322c1-proc\") pod \"perf-node-gather-daemonset-ps2t9\" (UID: \"f209ecd1-bf0d-42de-942f-42f1ffa322c1\") " pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:20.460977 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.460902    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f209ecd1-bf0d-42de-942f-42f1ffa322c1-podres\") pod \"perf-node-gather-daemonset-ps2t9\" (UID: \"f209ecd1-bf0d-42de-942f-42f1ffa322c1\") " pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:20.460977 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.460946    5021 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f209ecd1-bf0d-42de-942f-42f1ffa322c1-lib-modules\") pod \"perf-node-gather-daemonset-ps2t9\" (UID: \"f209ecd1-bf0d-42de-942f-42f1ffa322c1\") " pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:20.460977 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.460966    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f209ecd1-bf0d-42de-942f-42f1ffa322c1-proc\") pod \"perf-node-gather-daemonset-ps2t9\" (UID: \"f209ecd1-bf0d-42de-942f-42f1ffa322c1\") " pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:20.461273 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.460994    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f209ecd1-bf0d-42de-942f-42f1ffa322c1-podres\") pod \"perf-node-gather-daemonset-ps2t9\" (UID: \"f209ecd1-bf0d-42de-942f-42f1ffa322c1\") " pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:20.461273 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.461061    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f209ecd1-bf0d-42de-942f-42f1ffa322c1-lib-modules\") pod \"perf-node-gather-daemonset-ps2t9\" (UID: \"f209ecd1-bf0d-42de-942f-42f1ffa322c1\") " pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:20.525454 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.525383    5021 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnkxj\" (UniqueName: \"kubernetes.io/projected/f209ecd1-bf0d-42de-942f-42f1ffa322c1-kube-api-access-lnkxj\") pod \"perf-node-gather-daemonset-ps2t9\" (UID: \"f209ecd1-bf0d-42de-942f-42f1ffa322c1\") " pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:20.576871 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.576834    5021 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:20.722600 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.722563    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-kfwnf_449ee7b6-e6dd-4aef-933c-722a0eb63ae1/server/0.log"
Nov 03 19:15:20.962739 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:20.962689    5021 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"]
Nov 03 19:15:20.976840 ip-10-0-137-219 kubenswrapper[5021]: W1103 19:15:20.964973    5021 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf209ecd1_bf0d_42de_942f_42f1ffa322c1.slice/crio-865cf578a8a45182ec9caef5233902f2442492193900c7f892b25c78e13e3f56 WatchSource:0}: Error finding container 865cf578a8a45182ec9caef5233902f2442492193900c7f892b25c78e13e3f56: Status 404 returned error can't find the container with id 865cf578a8a45182ec9caef5233902f2442492193900c7f892b25c78e13e3f56
Nov 03 19:15:21.009203 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:21.009169    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9" event={"ID":"f209ecd1-bf0d-42de-942f-42f1ffa322c1","Type":"ContainerStarted","Data":"865cf578a8a45182ec9caef5233902f2442492193900c7f892b25c78e13e3f56"}
Nov 03 19:15:22.018251 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:22.018180    5021 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9" event={"ID":"f209ecd1-bf0d-42de-942f-42f1ffa322c1","Type":"ContainerStarted","Data":"d73b17fc101b76cfd9a03bb27fd55736fde35bf5fa9ffa474c45007aa58cf39f"}
Nov 03 19:15:22.018735 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:22.018278    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:22.035274 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:22.035181    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-sg7cz_321a5ab2-29da-497d-83ac-68121f5fe200/manager/0.log"
Nov 03 19:15:22.138391 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:22.138312    5021 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9" podStartSLOduration=2.138293642 podStartE2EDuration="2.138293642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:15:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:15:22.137159581 +0000 UTC m=+7122.338497634" watchObservedRunningTime="2026-11-03 19:15:22.138293642 +0000 UTC m=+7122.339631694"
Nov 03 19:15:22.200271 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:22.200218    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-jvcqp_782d07ab-b807-400c-b2b2-74989c3f84e9/proxy/0.log"
Nov 03 19:15:22.829180 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:22.829048    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-bbqqn_21278b76-fc4f-45fc-96d3-e8898bead3dd/manager/0.log"
Nov 03 19:15:26.714880 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:26.714834    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-kfwnf_449ee7b6-e6dd-4aef-933c-722a0eb63ae1/server/0.log"
Nov 03 19:15:27.997022 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:27.996986    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-sg7cz_321a5ab2-29da-497d-83ac-68121f5fe200/manager/0.log"
Nov 03 19:15:28.034664 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:28.034638    5021 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-45cfb/perf-node-gather-daemonset-ps2t9"
Nov 03 19:15:28.158921 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:28.158880    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-jvcqp_782d07ab-b807-400c-b2b2-74989c3f84e9/proxy/0.log"
Nov 03 19:15:28.573255 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:28.573202    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-2wbdt_e4451ce6-8729-4567-9e85-d5eba0db6139/cluster-monitoring-operator/0.log"
Nov 03 19:15:32.718604 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:32.718559    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-kfwnf_449ee7b6-e6dd-4aef-933c-722a0eb63ae1/server/0.log"
Nov 03 19:15:33.750507 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:33.750468    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t4x87_91f43bc3-b6fc-4222-acee-6932941b6cb9/node-exporter/0.log"
Nov 03 19:15:34.046026 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:34.045988    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-sg7cz_321a5ab2-29da-497d-83ac-68121f5fe200/manager/0.log"
Nov 03 19:15:34.154932 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:34.154900    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t4x87_91f43bc3-b6fc-4222-acee-6932941b6cb9/kube-rbac-proxy/0.log"
Nov 03 19:15:34.198111 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:34.198080    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-jvcqp_782d07ab-b807-400c-b2b2-74989c3f84e9/proxy/0.log"
Nov 03 19:15:34.578776 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:34.578750    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t4x87_91f43bc3-b6fc-4222-acee-6932941b6cb9/init-textfile/0.log"
Nov 03 19:15:37.046096 ip-10-0-137-219 kubenswrapper[5021]: E1103 19:15:37.046057    5021 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9lj8v" containerName="extractor"
Nov 03 19:15:39.128303 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:39.128274    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-95446_414225d4-1413-466a-ac33-934261621dfc/prometheus-operator/0.log"
Nov 03 19:15:39.527605 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:39.527573    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-95446_414225d4-1413-466a-ac33-934261621dfc/kube-rbac-proxy/0.log"
Nov 03 19:15:39.939042 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:39.938953    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-v77q9_67f75b9b-4d90-46f1-942f-e3fb290e46d3/prometheus-operator-admission-webhook/0.log"
Nov 03 19:15:40.402122 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:40.402093    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fc78d544-6rgm9_bc948976-0edc-4e93-a9a9-58a58432b280/kube-auth-proxy/0.log"
Nov 03 19:15:40.834714 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:40.834681    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-4ccf2_0e75cfd4-5493-4f9e-9f1d-21af42b4ad96/istio-proxy/0.log"
Nov 03 19:15:41.086310 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:41.086206    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-7q4j8_90d05521-4431-4dca-85e3-bc3d881dfe1f/istio-proxy/0.log"
Nov 03 19:15:42.164169 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:42.164141    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-sz4qn_5bacd2fb-f446-4db3-bb86-92a9d923a034/istio-proxy/0.log"
Nov 03 19:15:43.661598 ip-10-0-137-219 kubenswrapper[5021]: I1103 19:15:43.661567    5021 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-678bd9c4d9-wrhq6_12b0e63f-73f7-429a-879d-617267cc5f36/router/0.log"